Unsolved
1 Rookie
•
124 Posts
0
1545
October 30th, 2020 02:00
jsvc / authc consumes all available memory
Hello,
NW 19.2.1.2 here, although the problem is not new in that version.
jsvc is slowly consuming all available physical memory no matter how much you give to the server.
Anyone already experienced this?
Thx.
No Events found!
crazyrov
4 Operator
•
1.3K Posts
0
October 30th, 2020 07:00
Hi @jammac , how is your server sized? Also, what OS are you using on the backup server?
jammac
1 Rookie
•
124 Posts
0
October 30th, 2020 07:00
OS is Linux.
As you can see from the graph there are 24 GB. But you can give it 100GB, the graph will look the same. jsvc will simply consume more and more memory until everything goes OOM and processes are randomly killed.
crazyrov
4 Operator
•
1.3K Posts
0
October 30th, 2020 22:00
@jammac, I have 19.2.0.1 and I have been monitoring it for sometime now and it is never gone above 7% memory utilization. This is not a huge environment but again it shouldn't matter for the authc service. Have you checked if there might be a memory leak with this binary from an OS perspective because from your explanation that is what is looks like.
Also, I hope you have considered that Linux uses memory to cache/buffering thus Linux tries to use all the memory available for something. free -m could give you a better idea about it if not checked yet.
jammac
1 Rookie
•
124 Posts
0
October 31st, 2020 07:00
I'm well aware of "Linux ate my RAM". So does Windows BTW. But that's not it in this case.
RSS and virtual memory for that process go through the roof. Eventually random processes are killed by OOM killer. Support doesn't understand a thing. We are now at the third person of first level support. All they are able to tell us is to give the machine more RAM or just that it's out of their league. I won't play this game. I'll escalate until someone understands. Unfortunately, by experience, Dell software support may take some time with that.
crazyrov
4 Operator
•
1.3K Posts
0
November 2nd, 2020 00:00
Strange indeed. Do you have multiple NetWorker servers who use the authc from this server or any special uses cases in your environment for your authc, integration with AD?
jammac
1 Rookie
•
124 Posts
0
November 4th, 2020 00:00
This is a standard setup with a networker server, an nmc, and two storage nodes.
The only "special" thing is that we are doing is polling the REST API every 15 minutes using our monitoring software, in order to get the current status of the pools. I guess that's what the REST API is there for. And if that is the reason for the leak then really noone has ever actually tested it. I wouldn't be surprised.
Actually people may not even notice an out-of-memory situation because it will silently restart. Unfortunately last time OOM killer killed nsrmmdbd. That time, we noticed.