How To Access Video Data

Hello and thank you for your time, i am little new to jitsi so sorry if i my question does not make much sense.
The company i work at needs to be able to show the emotions of the people in the meeting , we want to show the emotions via little icons in the screen of each participant , to do this we have an api that takes little fragments of video and respond with an emotion.
What i want to know is how to access the video data of each participant and send it to my api and also how later associate the response of the api to each corresponding user, all this in a way that is scalabe to a lot of users.