Contextual Understanding Of Sequential Data Across Multiple Modalities