Converting as image file from SIPSorceryMedia.Abstractions.RawImage to Avalonia.Media.Imaging.Bitmap

[mail2mhossain]

I am using SIPSorceryMedia.FFmpeg (https://github.com/sipsorcery-org/SIPSorceryMedia.FFmpeg) in one of my project. They exposed video frame as SIPSorceryMedia.Abstractions.RawImage. Becuase System.Drawing.Image is not a cross platform.

Now I want to convert SIPSorceryMedia.Abstractions.RawImage to Avalonia.Media.Imaging.Bitmap. So that I can display the image in Avalonia App. I have tried this way:

Bitmap avalonia_bitmap = new Bitmap(Avalonia.Platform.PixelFormat.Rgb565, Avalonia.Platform.AlphaFormat.Premul,
rawImage.Sample,
new Avalonia.PixelSize(rawImage.Width, rawImage.Height),
new Avalonia.Vector(96, 96),
rawImage.Stride);

but no luck.

If I change Avalonia.Platform.PixelFormat.Bgra8888 or Avalonia.Platform.PixelFormat.Rgba8888, getting error 'Unable to create bitmap from provided data'

Any help in this regards. [https://github.com/sipsorcery-org/SIPSorceryMedia.FFmpeg/issues/45]

[jp2masa]

What is the value of rawImage.PixelFormat?

[mail2mhossain]

SIPSorceryMedia.Abstractions.VideoPixelFormatsEnum.Rgb

public enum VideoPixelFormatsEnum
{
Rgb = 0, // 24 bits per pixel.
Bgr = 1, // 24 bits per pixel.
Bgra = 2, // 32 bits per pixel.
I420 = 3, // 12 bits per pixel.
NV12 = 4, // 12 bits per pixel.
}

public class RawImage
{
public RawImage ();

public int Width { get; set; }
public int Height { get; set; }
public int Stride { get; set; }
public IntPtr Sample { get; set; }
public VideoPixelFormatsEnum PixelFormat { get; set; }

public byte[] GetBuffer ();
}

[mail2mhossain]

I have converted SIPSorceryMedia.Abstractions.RawImage rawImage to System.Drawing.Bitmap with the following code:

Bitmap bitmap = new Bitmap(rawImage.Width, rawImage.Height, rawImage.Stride, PixelFormat.Format24bppRgb, rawImage.Sample);

After that converted this to Avalonia.Media.Imaging.Bitmap with the following code:

System.Drawing.Bitmap bitmapTmp = new System.Drawing.Bitmap(bitmap);
var bitmapdata = bitmapTmp.LockBits(new Rectangle(0, 0, bitmapTmp.Width, bitmapTmp.Height), ImageLockMode.ReadWrite, PixelFormat.Format32bppArgb);
Bitmap bitmap1 = new Bitmap(Avalonia.Platform.PixelFormat.Bgra8888, Avalonia.Platform.AlphaFormat.Premul,
bitmapdata.Scan0,
new Avalonia.PixelSize(bitmapdata.Width, bitmapdata.Height),
new Avalonia.Vector(96, 96),
bitmapdata.Stride);
bitmapTmp.UnlockBits(bitmapdata);
bitmapTmp.Dispose();

AND it is working in Windows platform. To work in cross-platform (Win, Linux, OSX), I want to convert SIPSorceryMedia.Abstractions.RawImage rawImage to Avalonia.Media.Imaging.Bitmap directly. Any help in this regards?

[maxkatz6]

Try to create it with WriteableBitmap by copying pixel data to the locked buffer. Like here https://github.com/AvaloniaUI/Avalonia/blob/master/src/Avalonia.Controls.ColorPicker/Helpers/ColorPickerHelpers.cs#L606-L627

[maxkatz6]

Also, important to find out correct PixelFormat that RawImage is using, by converting VideoPixelFormatsEnum I assume.

[mail2mhossain]

"Also, important to find out correct PixelFormat that RawImage is using, by converting VideoPixelFormatsEnum I assume."

I think here I am stuck. Need more help in this regards.

[maxkatz6]

Unfortunately, I don't have experience with this library.
If you have any more questions about Avalonia, I can try to help/answer.