Switch file source in ffmpeg

[Naihan]

I have an algorithm that manipulate a jpeg image that comes out of a camera and I want to send it to webRTCservice.

I was able to use one of the code samples to create a mock app but with a single static file.

private static Task<RTCPeerConnection> CreatePeerConnection()
        {
            RTCConfiguration config = new RTCConfiguration
            {
                iceServers = new List<RTCIceServer> { new RTCIceServer { urls = STUN_URL } }
            };

            _peerConnection = new RTCPeerConnection(config);

            SIPSorceryMedia.FFmpeg.FFmpegFileSource fileSource = new SIPSorceryMedia.FFmpeg.FFmpegFileSource("path to file.jpg", true, null, 960, true);

           
            _videoSource = fileSource as IVideoSource;

            _videoSource.RestrictFormats(x => x.Codec == _videoCodec);
            MediaStreamTrack videoTrack = new MediaStreamTrack(_videoSource.GetVideoSourceFormats(), MediaStreamStatusEnum.SendRecv);

            _peerConnection.addTrack(videoTrack);
            _videoSource.OnVideoSourceEncodedSample += _peerConnection.SendVideo;
            _peerConnection.OnVideoFormatsNegotiated += (videoFormats) => _videoSource.SetVideoSourceFormat(videoFormats.First());

            

            return Task.FromResult(_peerConnection);
}

My question is how do I change the file once I receive the next image from my algo service, or if there is a smarter way to do that like using a stream

Thanks :-)

[ChristopheI]

• Store the video format used in the connection
• stop / dispose correctly your previous _videoSource
• create your new _videoSource and use SetVideoSourceFormat and OnVideoSourceEncodedSample as you already did

[Naihan]

What if the jpeg image I receive from my algo is a byte[] ?

[inbargoldman]

• Store the video format used in the connection
• stop / dispose correctly your previous _videoSource
• create your new _videoSource and use SetVideoSourceFormat and OnVideoSourceEncodedSample as you already did

Hi,
I have the same problem
I want to send the data to webRTCservice as byte[]

the byte array is dynamically changed
Is there as way to send data as dynamically byte[]?

Thanks

[ha-ves]

@Naihan
What if the jpeg image I receive from my algo is a byte[] ?

We're not sure what you mean by that, are you using your own implementation to do the JPEG to be sent via RTP? if so this repo is not the right place.

Then to also answer this,

@inbargoldman

• Store the video format used in the connection
• stop / dispose correctly your previous _videoSource
• create your new _videoSource and use SetVideoSourceFormat and OnVideoSourceEncodedSample as you already did

Hi, I have the same problem I want to send the data to webRTCservice as byte[]

the byte array is dynamically changed Is there as way to send data as dynamically byte[]?

Thanks

If you meant sending byte[] via Data Channel, you can head to the main sipsorcery repo to find example for sending data using DataChannel