Get Media Stream only for visible occupants

Lets say i have a conference with 40 occupants, each sending video. So each occupant receives 40 Videostreams of all occupants, right? Or did every user only receive the videostreams of the speaking person and the visible thumbnails?