Skip Navigation
Lemmy instance using a lot of ram

I have my own Lemmy instance (Lemmy.emphisia.nl) but I had to take it offline, after running a while it was using more than half of the system memory (16gb in total). Causing the computer to crash as there are a lot of other services also running on it. The problem appears to come from postgress. In btop I can see it spawning a lot of processes all taking up about 80 MB in the beginning but rising as it runs, rising as high as 250 MB per process. I have already tried adjusting the postgress config to be optimized for less memory, but it seems to do nothing.

Is this normal, and if not, what is going wrong?

10
self hosted lemmy 502 pictrs
  • yeah i changed that because i was testing. but i now realize that was dumb. ive change both the hostname and the url to pictrs. OMG that just worked..... i feel so dumb rn. it is strange tho because that wasnt working before. Thanks for all the help :)

  • self hosted lemmy 502 pictrs
  • PICTRS__SERVER__API_KEY

    the config in docker compose looks like

      pictrs:
        image: asonix/pictrs:0.4.0
        # this needs to match the pictrs url in lemmy.hjson
        hostname: 127.0.0.1
        # we can set options to pictrs like this, here we set max. image size and forced format for conversion
        # entrypoint: /sbin/tini -- /usr/local/bin/pict-rs -p /mnt -m 4 --image-format webp
        environment:
          - PICTRS_OPENTELEMETRY_URL=http://otel:4137
          - PICTRS__SERVER__API_KEY=****
          - RUST_LOG=debug
          - RUST_BACKTRACE=full
          - PICTRS__MEDIA__VIDEO_CODEC=vp9
          - PICTRS__MEDIA__GIF__MAX_WIDTH=256
          - PICTRS__MEDIA__GIF__MAX_HEIGHT=256
          - PICTRS__MEDIA__GIF__MAX_AREA=65536
          - PICTRS__MEDIA__GIF__MAX_FRAME_COUNT=400
        user: 991:991
    

    and in the config it is

      pictrs: {
        url: "http://127.0.0.1:8080/"
        api_key: "****"
      }
    

    the password on both is the same so i don't see what is going wrong :(

  • self hosted lemmy 502 pictrs
  • it does appear to be in its own network (according to portainer) the error log in the lemmy container is

    2023-07-23T13:58:44.850844Z  WARN lemmy_server::root_span_builder: Request error: error sending request for url (http://127.0.0.1:8080/image): error trying to connect: tcp connect error: Connection refused (os error 111)
    
    Reqwest(reqwest::Error { kind: Request, url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv4(127.0.0.1)), port: Some(8080), path: "/image", query: None, fragment: None }, source: hyper::Error(Connect, ConnectError("tcp connect error", Os { code: 111, kind: ConnectionRefused, message: "Connection refused" })) })
    

    no errors appear when i look at the pictrs log. I don't know why it says password: None as i've set a password

  • self hosted lemmy 502 pictrs
  • yeah I've already done that, I did sudo chown -r 991:991 volumes/pictrs. what details do you need about my setup? edit: I do know another program is already using port 8080 on my host machine, or does that not matter when it's running inside docker?

  • self hosted lemmy 502 pictrs

    Hi,

    I've been trying to host my own lemmy instance for a while. i've almost got it working (i think). But my problem now is that whenever i try to post something with a picture i get an error SyntaxError: JSON.parse: unexpected character at line 1 column 1 of the JSON data. In firefox i get a 502 bad gateway error pointing to https://lemmy.emphisia.nl/pictrs/image I don't really know why because everything seems to be working

    14
    404 /api/v3/user/login when logging in
  • hi, apologies for the incredibly late response, i was on vacation. So as per the setup guide of lemmy. i am using two nginx instances. one i a lemmy internal nginx, running in a container which uses the nginx-internal config file. This exposes lemmy on port 8085. i then want to use a reverse proxy so that i can access the website on lemmy.emphisia.nl for that i use a second nginx running on the host machine. this one is the reverse proxy for all services i have running on the machine. (nextcloud, onlyoffice, bitmanager and lemmy)

  • 404 /api/v3/user/login when logging in
  • I actually need the website to be hosted at 8085, as the nginx reverse proxy is listening at that adres, and it has already bound to port 80 and 443. When i open internal port 80 to 8085 and set the lemmy port to 8086 in the compose file. when i then visit the site i get a redirect loop. (im probably doing something horribly wrong). Also lemmy keeps panicking

  • 404 /api/v3/user/login when logging in
  • thank you, the config now runs, unfortunately i am now getting a bad gateway when visiting the website. Also in the logs i see two errors that catch my eye thread 'main' panicked at 'Failed to load settings file, see documentation (https://join-lemmy.org/docs/en/administration/configuration.html): LemmyError { message: None, inner: Is a directory (os error 21), context: SpanTrace [] }', crates/utils/src/settings/mod.rs:20:20 and caddy_1 | {"level":"error","ts":1688725909.314515,"logger":"http.acme_client","msg":"challenge failed","identifier":"lemmy.emphisia.nl","challenge_type":"http-01","problem":{"type":"","title":"","detail":"","instance":"","subproblems":[]}}

    Also according to portainer, no ports are open on the caddy server. I have never used caddy. Thank you btw for trying to help me :))

  • 404 /api/v3/user/login when logging in
  • thank you very much for your config file, however on pasting it and running it, i get the error

    ERROR: The Compose file './docker-compose.yml' is invalid because:
    Unsupported config option for services.caddy: 'lemmy'
    
  • 404 /api/v3/user/login when logging in
  • according to portainer, no other docker containers are using ports, so i don't know what ports to set them as. I assume they are communicating over an internal network and the nginx is the only open external port.

    I am using two nginx servers because one nginx server is used by lemmy to give me one port to access. And the other one i use to set up my reverse proxy so that i can host more than one service on my server.

    I dont know why i have different versions of the ui and backend. I am just using the latest version avalible on the docker website.

    My docker compose file looks like this and the lemmy config file looks like this i got this config from here because i was looking for a way to correctly set-up my email because de documentation about the config file is really bad. But when using the default config file (found here).

  • 404 /api/v3/user/login when logging in
  • I am actually already running that config in the internal nginx, but i've never changed anything about it. what do i need to specify when they say "# this needs to map to the lemmy (server) docker service hostname" do they want the name of the docker container, and do they want the internal or external port?

  • Lemmy Support @lemmy.ml youpie_temp @reddthat.com
    404 /api/v3/user/login when logging in

    Hello, I've been trying to host my own lemmy instance for a little while now but have yet to be successful.

    I recently had my lemmy instance running but i could not find other communities, so i decided to remove everything and try again. Now however when i try to create an account or log in i get the error 404 for the file /api/v3/user/loginand nothing happens.

    I've tried removing everything again and starting again but it is still not working

    in the lemmy docker container i get the following error 2023-07-06T12:27:55.845049Z WARN lemmy_server::root_span_builder: couldnt_find_that_username_or_email: Record not found 1: lemmy_server::root_span_builder::HTTP request 0: lemmy_api::local_user::login::perform at crates/api/src/local_user/login.rs:16 with http.method=POST http.scheme="http" http.host=lemmy.emphisia.nl http.target=/api/v3/user/login otel.kind="server" request_id=7896c156-ba9f-42cd-8f1a-c0233c3018a7 LemmyError { message: Some("couldnt_find_that_username_or_email"), inner: Record not found, context: SpanTrace [{ target: "lemmy_api::local_user::login", name: "perform", fields: "self=Login { username_or_email: Sensitive, password: Sensitive, totp_2fa_token: None }", file: "crates/api/src/local_user/login.rs", line: 16 }, { target: "lemmy_server::root_span_builder", name: "HTTP request", fields: "http.method=POST http.scheme=\"http\" http.host=lemmy.emphisia.nl http.target=/api/v3/user/login otel.kind=\"server\" request_id=7896c156-ba9f-42cd-8f1a-c0233c3018a7", file: "src/root_span_builder.rs", line: 16 }] } with self=Login { username_or_email: Sensitive, password: Sensitive, totp_2fa_token: None } at src/root_span_builder.rs:16

    edit: i just managed to log in, however the federation does not seem to be working. None show up in the communities tab and if i look for any communities i get no results and this in the log ``` 2023-07-06T14:09:32.699162Z WARN lemmy_server::root_span_builder: couldnt_find_object: Failed to resolve actor via webfinger

    0: lemmy_apub::fetcher::search::search_query_to_object_id

    at crates/apub/src/fetcher/search.rs:19

    1: lemmy_apub::api::resolve_object::perform

    with self=ResolveObject { q: "!asklemmy", auth: Sensitive }

    at crates/apub/src/api/resolve_object.rs:21

    2: lemmy_server::root_span_builder::HTTP request

    with http.method=GET http.scheme="http" http.host=lemmy.emphisia.nl http.target=/api/v3/resolve_object otel.kind="server" request_id=34386e88-9099-4d83-a6a2-360ee7924064

    at src/root_span_builder.rs:16

    LemmyError { message: Some("couldnt_find_object"), inner: Failed to resolve actor via webfinger, context: SpanTrace [{ target: "lemmy_apub::fetcher::search", name: "search_query_to_object_id", file: "crates/apub/src/fetcher/search.rs", line: 19 }, { target: "lemmy_apub::api::resolve_object", name: "perform", fields: "self=ResolveObject { q: \"!asklemmy\", auth: Sensitive }", file: "crates/apub/src/api/resolve_object.rs", line: 21 }, { target: "lemmy_server::root_span_builder", name: "HTTP request", fields: "http.method=GET http.scheme=\"http\" http.host=lemmy.emphisia.nl http.target=/api/v3/resolve_object otel.kind=\"server\" request_id=34386e88-9099-4d83-a6a2-360ee7924064", file: "src/root_span_builder.rs", line: 16 }] } ``` it doesn't matter what i search, this always happens

    22
    Lemmy Support @lemmy.ml youpie_temp @reddthat.com
    Can't find anything outside of self hosted instance

    Hi,

    Im trying to self host lemmy with docker. Everything seems to have set up correctly. However I can't find other communities, users or posts from my server. I can't see any errors in the logs and when i run curl -H "Accept: application/activity+json" https://lemmy.emphisia.nl/u/youpie it gives a correct response. The server is lemmy.emphisia.nl and it is running behind a reverse nginx proxy. Using the config found in the ansible playbook (because i couldn't find it anywhere else)

    1
    InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)YO
    youpie_temp @reddthat.com
    Posts 4
    Comments 20