Memory utilization remain high after a long streaming time #6341

sst5000 · 2024-05-20T10:57:46Z

Short description

After running a few publishers on the AMS server for a long time memory utilization remains high.

Environment

Operating system and version:Ubuntu 20.04
Java version: openjdk version "17.0.10" 2024-01-16
OpenJDK Runtime Environment (build 17.0.10+7-Ubuntu-120.04.1)
OpenJDK 64-Bit Server VM (build 17.0.10+7-Ubuntu-120.04.1, mixed mode, sharing)
Ant Media Server version: Enterprise Edition 2.9.0 20240405_1755
Browser name and version: Chrome Version 124.0.6367.209 (Official Build) (64-bit)

Steps to reproduce

Run a few publishers and players on a single instance of the AMS
Keep it running for one day
After that remove some publisher from it.

Expected behavior

The memory utilized should drop to some level

Actual behavior

The memory utilization will go high so some value (suppose 55%). It will remain at 55% if we remove the publisher or viewer.

Logs

Place logs on pastebin or elsewhere and put links here

Ask your questions on Ant Media Github Discussions

lastpeony · 2024-05-22T08:04:35Z

Have you ever faced with a crash due to this?

brixxnatt · 2024-05-24T19:01:34Z

I confirm this too

sst5000 · 2024-05-26T13:04:08Z

Yes crash issue too.

…

On Wed, May 22, 2024 at 1:34 PM Last Peony ***@***.***> wrote: Have you ever faced with a crash due to this? — Reply to this email directly, view it on GitHub <#6341 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUTILN3XQBS42GI2FE2WCADZDRGSRAVCNFSM6AAAAABH7QBMP6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMRUGEZTCNZYGU> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- Regards, Shivani @ http://sst5000.blogspot.in/ <http://sst5000.wordpress.com>

brixxnatt · 2024-05-26T13:27:35Z

Yes when the erros accumilate and add to the RAM , in 3 days my rams will be 100% , server will crash , cant use it , so now i am restarting the server each 2 days , this is HELL

brixxnatt · 2024-05-29T14:29:43Z

JVM Heap Memory stay the same
System CPU Load stay the same
System Memory Accumilating up 100 mb each 30 seconds

lastpeony · 2024-05-31T07:17:29Z

Hello @sst5000 do you publish with webrtc, rtmp or srt?

sst5000 · 2024-05-31T12:21:30Z

webrtc

…

On Fri, May 31, 2024 at 12:47 PM Last Peony ***@***.***> wrote: Hello @sst5000 <https://github.com/sst5000> do you publish with webrtc, rtmp or srt? — Reply to this email directly, view it on GitHub <#6341 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUTILN2BB2LUAINWQWARN2DZFAP2BAVCNFSM6AAAAABH7QBMP6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBRGM3TEOJQHA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- Regards, Shivani @ http://sst5000.blogspot.in/ <http://sst5000.wordpress.com>

lastpeony · 2024-06-03T06:12:35Z

@sst5000 Hello,
I am trying to reproduce this problem on my end to see if there is a memory leak on our end but i could not manage to reproduce.
Here is the behaviour i observed:
1-)Suppose you publish10 webrtc streams and you observed 1GB increase in system memory.
2-)Stop all streams. You wont observe a 1GB decrease in system memory. You should observe decrease in JVM heap memory.
3-) When you restart 10 webrtc streams again, you should not observe 1GB increase in system memory. The previous allocation will be utilized.
If this is the behaviour you observe its normal and expected behaviour.
If you observe 1GB increase in step 3, then its a problem and we need to connect and check it together.
If thats the case letst schedule a meeting and observe the behaviour together. emre.guney@antmedia.io

sst5000 · 2024-06-04T06:50:00Z

Sure. I restart the ANT media server every two days due to high memory utilization. So, I need to connect. Please share the invite.

…

On Mon, Jun 3, 2024 at 11:42 AM Last Peony ***@***.***> wrote: @sst5000 <https://github.com/sst5000> Hello, I am trying to reproduce this problem on my end to see if there is a memory leak on our end but i could not manage to reproduce. Here is the behaviour i observed: 1-)Suppose you publish10 webrtc streams and you observed 1GB increase in system memory. 2-)Stop all streams. You wont observe a 1GB decrease in system memory. You should observe decrease in JVM heap memory. 3-) When you restart 10 webrtc streams again, you should not observe 1GB increase in system memory. The previous allocation will be utilized. If this is the behaviour you observe its normal and expected behaviour. If you observe 1GB increase in step 3, then its a problem and we need to connect and check it together. If thats the case letst schedule a meeting and observe the behaviour together. ***@***.*** — Reply to this email directly, view it on GitHub <#6341 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUTILN2HF3AXXHYSTE7XZK3ZFQCOVAVCNFSM6AAAAABH7QBMP6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBUGM2TMMRYHE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- Regards, Shivani @ http://sst5000.blogspot.in/ <http://sst5000.wordpress.com>

lastpeony · 2024-06-04T09:32:35Z

@sst5000
I scheduled a meeting to check it together with you for 5.06.2024 9 AM GMT+3
Check Webrtc Memory
Wednesday, June 5 · 9:00 – 10:00am
Time zone: Europe/Istanbul
Google Meet joining info
Video call link: https://meet.google.com/zvc-wfjk-dvp
Or dial: ‪(TH) +66 2 844 9331‬ PIN: ‪575 501 085 9821‬#
More phone numbers: https://tel.meet/zvc-wfjk-dvp?pin=5755010859821

Please send me your e mail, if time does not fit you we can schedule again.

lastpeony · 2024-06-04T18:03:42Z

@sst5000
You can directly e mail me for this.
emre.guney@antmedia.io

sst5000 · 2024-06-06T06:05:00Z

Hi, Thank you for taking time out for this. Unfortunately, I wasn't able to attend. Please reschedule it for 7th Jun 2024. 9:00 – 10:00 am Time zone: Europe/Istanbul I will be there.

…

On Tue, Jun 4, 2024 at 3:02 PM Last Peony ***@***.***> wrote: @sst5000 <https://github.com/sst5000> I scheduled a meeting to check it together with you for 5.06.2024 9 AM GMT+3 Check Webrtc Memory Wednesday, June 5 · 9:00 – 10:00am Time zone: Europe/Istanbul Google Meet joining info Video call link: https://meet.google.com/zvc-wfjk-dvp Or dial: ‪(TH) +66 2 844 9331‬ PIN: ‪575 501 085 9821‬# More phone numbers: https://tel.meet/zvc-wfjk-dvp?pin=5755010859821 Please send me your e mail, if time does not fit you we can schedule again. — Reply to this email directly, view it on GitHub <#6341 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AUTILNYFA4IST2AKPQ53JO3ZFWCUTAVCNFSM6AAAAABH7QBMP6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBXGA2TQOBVGQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- Regards, Shivani @ http://sst5000.blogspot.in/ <http://sst5000.wordpress.com>

lastpeony · 2024-06-14T13:25:56Z

Hi, Thank you for taking time out for this. Unfortunately, I wasn't able to attend. Please reschedule it for 7th Jun 2024. 9:00 – 10:00 am Time zone: Europe/Istanbul I will be there.
…
On Tue, Jun 4, 2024 at 3:02 PM Last Peony @.> wrote: @sst5000 https://github.com/sst5000 I scheduled a meeting to check it together with you for 5.06.2024 9 AM GMT+3 Check Webrtc Memory Wednesday, June 5 · 9:00 – 10:00am Time zone: Europe/Istanbul Google Meet joining info Video call link: https://meet.google.com/zvc-wfjk-dvp Or dial: ‪(TH) +66 2 844 9331‬ PIN: ‪575 501 085 9821‬# More phone numbers: https://tel.meet/zvc-wfjk-dvp?pin=5755010859821 Please send me your e mail, if time does not fit you we can schedule again. — Reply to this email directly, view it on GitHub <#6341 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AUTILNYFA4IST2AKPQ53JO3ZFWCUTAVCNFSM6AAAAABH7QBMP6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBXGA2TQOBVGQ . You are receiving this because you were mentioned.Message ID: @.>
-- Regards, Shivani @ http://sst5000.blogspot.in/ http://sst5000.wordpress.com

Can you schedule a meeting through this link?
https://calendly.com/lastpeony

sst5000 · 2024-06-27T07:45:17Z

HI I just got the high memory utilization message. VM configuration: Cpu 4 core and 8GB RAM [image: image.png]

…

On Thu, Jun 6, 2024 at 11:34 AM Shivani Thakur ***@***.***> wrote: Hi, Thank you for taking time out for this. Unfortunately, I wasn't able to attend. Please reschedule it for 7th Jun 2024. 9:00 – 10:00 am Time zone: Europe/Istanbul I will be there. On Tue, Jun 4, 2024 at 3:02 PM Last Peony ***@***.***> wrote: > @sst5000 <https://github.com/sst5000> > I scheduled a meeting to check it together with you for 5.06.2024 9 AM > GMT+3 > Check Webrtc Memory > Wednesday, June 5 · 9:00 – 10:00am > Time zone: Europe/Istanbul > Google Meet joining info > Video call link: https://meet.google.com/zvc-wfjk-dvp > Or dial: ‪(TH) +66 2 844 9331‬ PIN: ‪575 501 085 9821‬# > More phone numbers: https://tel.meet/zvc-wfjk-dvp?pin=5755010859821 > > Please send me your e mail, if time does not fit you we can schedule > again. > > — > Reply to this email directly, view it on GitHub > <#6341 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AUTILNYFA4IST2AKPQ53JO3ZFWCUTAVCNFSM6AAAAABH7QBMP6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCNBXGA2TQOBVGQ> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> > -- Regards, Shivani @ http://sst5000.blogspot.in/ <http://sst5000.wordpress.com>

-- Regards, Shivani @ http://sst5000.blogspot.in/ <http://sst5000.wordpress.com>

muratugureminoglu · 2024-08-09T11:11:53Z

Agent Amarnath Thodupunoori linked Freshdesk ticket 128488 for this issue.

muratugureminoglu · 2024-08-13T15:06:12Z

Agent Alper KIZILTOPRAK created comment.

Email reading has been tracked by Email Tracking app

<div class="mail-track-note-header">
        Email was read
    2 minutes after it was sent

✉ Sent on 17:00:55 13 August 2024 +02:00

<div>✔ Read on 17:02:55 13 August 2024 +02:00</div>

</div>

burak-58 · 2024-10-07T09:51:29Z

For a similar and reproducible one we have this issue.

muratugureminoglu · 2024-10-08T11:11:14Z

Agent Amarnath Thodupunoori unlinked Freshdesk ticket 128488 from this issue.

burak-58 assigned lastpeony May 27, 2024

burak-58 added this to Ant Media Server May 27, 2024

burak-58 moved this to 🔖 Sprint in Ant Media Server May 27, 2024

burak-58 moved this from 🔖 Sprint to After sprint in Ant Media Server Jun 3, 2024

burak-58 moved this from After sprint to 🏗 In progress in Ant Media Server Jul 15, 2024

burak-58 assigned mekya Jul 29, 2024

This comment was marked as off-topic.

Sign in to view

burak-58 unassigned mekya Aug 20, 2024

burak-58 moved this from 🏗 In progress to Next Sprint in Ant Media Server Sep 23, 2024

burak-58 assigned burak-58 and unassigned lastpeony Sep 30, 2024

burak-58 closed this as completed Oct 7, 2024

github-project-automation bot moved this from 🔖 Sprint to ✅ Done in Ant Media Server Oct 7, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Memory utilization remain high after a long streaming time #6341

Memory utilization remain high after a long streaming time #6341

This comment was marked as off-topic.

Memory utilization remain high after a long streaming time #6341

Memory utilization remain high after a long streaming time #6341

Comments

Short description

Environment

Steps to reproduce

Expected behavior

Actual behavior

Logs

This comment was marked as off-topic.