Increased memory consumption after upgrading from v3.7.x to v4.2
-
Hey, so after the upgrade the memory consumption has been creeping up at a fairly steady rate and exceeding 1GB of memory. Is this something to be expected from the version upgrade? Or could it be due to our own changes / plugins we have? Or due to scrapers perhaps?
Upgrade happened on Monday 14th and before that the memory consumption was fairly steady at around 500MB. After the upgrade the memory consumption has been steadily going up during the day as seen in the pictures:
Screenshot when the sudden increase was noticed:
Here is last 7 days: (the falling edges are due to daily restart)
Screenshot from the /admin/development/info on the 23rd when it started also using swap.
Active plugins:
* nodebb-plugin-s3-uploads@3.0.5 (installed, enabled)
* nodebb-plugin-2factor@7.5.9 (installed, disabled)
* nodebb-plugin-composer-default@10.2.47 (installed, enabled)
* nodebb-plugin-dbsearch@6.2.13 (installed, enabled)
* nodebb-plugin-emoji@6.0.2 (installed, disabled)
* nodebb-plugin-emoji-android@4.1.1 (installed, disabled)
* nodebb-plugin-gravatar@4.0.0 (installed, enabled)
* nodebb-plugin-markdown@13.1.1 (installed, enabled)
* nodebb-plugin-mentions@4.7.1 (installed, enabled)
* nodebb-plugin-poll@3.2.5 (installed, disabled)
* nodebb-plugin-question-and-answer@1.2.7 (installed, enabled)
* nodebb-plugin-spam-be-gone@2.3.1 (installed, enabled)
* nodebb-plugin-sso-custom@1.0.0 (installed, enabled)
* nodebb-plugin-web-push@0.7.3 (installed, disabled)
* nodebb-plugin-write-api-custom@5.8.12 (installed, enabled)
* nodebb-rewards-essentials@1.0.1 (installed, enabled)
* nodebb-theme-harmony@2.0.40 (installed, disabled)
* nodebb-theme-lavender@7.1.18 (installed, disabled)
* nodebb-theme-peace@2.2.39 (installed, disabled)
* nodebb-theme-persona@14.0.16 (installed, disabled)
* nodebb-theme-custom@1.0.0 (installed, enabled)
* nodebb-widget-essentials@7.0.36 (installed, enabled)Nginx is being used to serve static assets and the config is the same as it was before the upgrade.
Setup:
Mongodb Atlas M40
Redis is Heroku’s own key value store premium 2
Heroku -> 4 dynos (Standard-2X variant)
In one dyno we have nginx + nodebbAny help would be greatly appreciated!
Thanks in advance.I would disable the daily restarts to see if the memory usage keeps going up or stabilizes.
-
S support@community.nodebb.org shared this topic on
-
Are you using the ActivityPub functionality? It might be related to that if only because that’s what’s new (among other smaller items) in v4.
If you toggle the global activitypub switch off, does that make memory usage stabilize?
Keep in mind that since you upgraded, ActivityPub is automatically disabled, so perhaps this is unrelated.
-
Are you using redis only or mongodb + redis? If redis only all forum data and sessions are stored there.
You can use redis insight to see keys click the tree view to group them by namespace.
-
@lassesuom my guess is they’re
sess:*keys. They can balloon up if you have lots of guests *cough* AI scrapers.There used to be logic so that guests didn’t receive a session key (since they didn’t really need one for regular browsing) but it could be that that detection no longer works.
-
Since we are using https://github.com/Psifi-Solutions/csrf-sync it creates a session whenever a guest loads the forum to set
config.csrf_token. Although we used that in 3.7.0 as well so not sure if that’s your issue or not.Sessions are also created for guests if you turn on “Allow guests to increase topic view counts”, to track which topics they’ve viewed.
