Passing Multidimensional time series to VLM [R]

Hello all,

I have a multidimensional time series dataset and corresponding environment videos. I want to pass them to a VLM to perform some tasks. What is the best way to pass the time series data? From the literature review, I see there are two methods: pass time series as text and plot line charts and pass those as images.

Neither method performed well on my task. Appreciate any guidance.