Lemmy v0.19.0 Release - Instance blocking, Scaled sort, and Federation Queue
Lemmy v0.19.0 Release - Instance blocking, Scaled sort, and Federation Queue
What is Lemmy?
Lemmy is a self-hosted social link aggregation and discussion platform. It is completely free and open, and not controlled by any company. This means that there is no advertising, tracking, or secret algorithms. Content is organized into communities, so it is easy to subscribe to topics that you are interested in, and ignore others. Voting is used to bring the most interesting items to the top.
Major Changes
This release is very large with almost 400 commits since 0.18.5. As such we can only give a general overview of the major changes in this post, and without going into detail. For more information, read the full changelog and linked issues at the bottom of this post.
Improved Post Ranking
There is a new scaled sort which takes into account the number of active users in a community, and boosts posts from less-active communities to the top. Additionally there is a new controversial sort which brings posts and comments to the top that have similar amounts of upvotes and downvotes. Lemmy's sorts are detailed here.
Instance Blocks for Users
Users can now block instances. Similar to community blocks, it means that any posts from communities which are hosted on that instance are hidden. However the block doesn't affect users from the blocked instance, their posts and comments can still be seen normally in other communities.
Two-Factor-Auth Rework
Previously 2FA was enabled in a single step which made it easy to lock yourself out. This is now fixed by using a two-step process, where the secret is generated first, and then 2FA is enabled by entering a valid 2FA token. It also fixes the problem where 2FA can be disabled without passing any 2FA token. As part of this change, 2FA is disabled for all users. This allows users who are locked out to get into their account again.
New Federation Queue
Outgoing federation actions are processed through a new persistent queue. This means that actions don't get lost if Lemmy is restarted. It is also much more performant, with separate senders for each target instance. This avoids problems when instances are unreachable. Additionally it supports horizontal scaling across different servers. The endpoint /api/v3/federated_instances contains details about federation state of each remote instance.
Remote Follow
Another new feature is support for remote follow. When browsing another instance where you don't have an account, you can click the subscribe button and enter the domain of your home instance in the popup dialog. It will automatically redirect you to your home instance where it fetches the community and presents a subscribe button. Here is a video showing how it works.
Authentication via Header or Cookie
Previous Lemmy versions used to send authentication tokens as part of the parameters. This was a leftover from websocket, which doesn't have any separate fields for this purpose. Now that we are using HTTP, authentication can finally be passed via jwt cookie or via header Authorization: Bearer <jwt>. The old authentication method is not supported anymore to simplify maintenance. A major benefit of this change is that Lemmy can now send cache-control headers depending on authentication state. API responses with login have cache-control: private, those without have cache-control: public, max-age=60. This means that responses can be cached in Nginx which reduces server load.
Moderation
Reports are now resolved automatically when the associated post/comment is marked as deleted. This reduces the amount of work for moderators. There is a new log for image uploads which stores uploader. For now it is used to delete all user uploads when an account is purged. Later the list can be used for other purposes and made available through the API.
Cursor based pagination
0.19 adds support for cursor based pagination on the /api/v3/post/list endpoint. This is more efficient for the database. Instead of a query parameter ?page=3, listing responses now include a field "next_page": "Pa46c" which needs to be passed as ?page_cursor=Pa46c. The existing pagination method is still supported for backwards compatibility, but will be removed in the next version.
User data export/import
Users can now export their data (community follows, blocklists, profile settings), and import it again on another instance. This can be used for account migrations and also as a form of backup. The export format is designed to remain unchanged for a long time. You can make regular exports, and if the instance becomes unavailable, register a new account and import the data. This way you can continue using Lemmy seamlessly.
Time zone handling
Lemmy didn't have any support for timezones, which led to bugs when federating with other platforms. This is now fixed by using UTC timezone for all timestamps.
ARM64 Support
Thanks to help from @raskyld and @kroese, there are now offical Lemmy releases for ARM64 available.
Activity now includes voters
- Previously, site and community activity counts were only based on people who commented, or posted. Those counts now include anyone who voted on a comment or post as well. Thanks to @Ategon for this change.
Upgrade instructions
Follow the upgrade instructions for ansible or docker. The upgrade should take less than 30 minutes.
If you need help with the upgrade, you can ask in our support forum or on the Matrix Chat.
Pict-rs 0.5 is also close to releasing. The upgrade takes a while due to a database migration, so read the migration guide to speed it up. Note that Lemmy 0.19 still works perfectly with pict-rs 0.4.
Thanks to everyone
We'd like to thank our many contributors and users of Lemmy for coding, translating, testing, and helping find and fix bugs. We're glad many people find it useful and enjoyable enough to contribute.
Support development
We (@dessalines and @nutomic) have been working full-time on Lemmy for over three years. This is largely thanks to support from NLnet foundation, as well as donations from individual users.
This month we are running a funding drive with the goal of increasing recurring donations from currently €4.000 to at least €12.000. With this amount @dessalines and @nutomic can each receive a yearly salary of €50.000 which is in line with median developer salaries. It will also allow one additional developer to work fulltime on Lemmy and speed up development.
Read more details in the funding drive announcement.
I'm doing my part! Cool to see my little change finally released, I hope people like it
Thank you
That's awesome dude, congrats!
Thanks for merging in some of my changes <3
Code block support should be great for posts coming from programming.dev and the active user change should help communities feel a bit more alive and be more accurate to actual activity
Cool! Code highliting!
Donate
Here's our donate page also: https://join-lemmy.org/donate
Liberapay is preferred, as they're open source, don't take a cut, and are funded by their own model.
It's always a treat to see the wheels of open source & community funding meshing together to bring about a better internet. You and @nutomic@lemmy.ml have already done the honors of thanking the open source contributors, so I think it's now my turn as an ordinary user to thank you both for your continued hard work and leadership -- I have my quibbles, but these do not preclude the giving of a well-deserved and hearty thanks: Thank you! It continues to please me greatly to have the privilege (in both senses of the word) to contribute to the financial sustainability of the project as one of its many small recurring donators.
And, while I'm at it... since the opportunity doesn't come up often: I also want to specifically express gratitude to dessalines for their (unrelated) work on the thumb-key project. As a long-time user of MessagEase (10+ years!), I've become a happy convert to your more well-maintained and open source replacement. So, thanks for that too! Please continue to suffer my past & future criticisms with the knowledge that it always originates from a place of equal parts respect & gratitude.
No probs, and thx for your support! I'm glad when anyone finds the things I work on useful.
We still have far to go privacy-wise, but finally there's FOSS alternatives for nearly every major app and comms platform. IMO the next big one that still needs to be tackled is youtube, and lemmy could have a part to play there.
Re thumb-key do you have recommended tutorials for getting comfortable with it? I found trying to do touch typing tutorials didn't really help, both because they are generally made for desktop environments and they are geared towards qwerty layout (e.g., get comfortable with home row first etc). I tried forcing myself to use it for a full 24 hours as the concept makes a ton of sense to me, but got very frustrated with myself and then dug into the world of which layout to choose, got overwhelmed, and switched back to whatever this qwerty layout that samsung one ui provides on galaxys.
@AdvogadoDoHardware@lemmy.eco.br Olha que massa!
Remote Follow sounds like a really amazing QoL improvement
Everything added is soo helpful. Congrats to the team and everyone else who contributed.
These are great features, thanks for all the work and congratulations on the release.
I will say though - in general, it would probably be easier and safer to do more incremental releases. It has been a long time since 0.18.5.
Have you considered adopting a release train model, similar to what Rust does? The Bevy game engine project has adopted such a model as well and it has worked well as far as I gather. The idea is basically to release on a fixed time interval, forever. No more surprises about when things release and there's a convenient regular opportunity to encourage people to donate :)
To expand on this, the problem with huge releases is that bugs tend to pile up along with the new features, simply because more stuff has been changed. You're much more likely to experience a painful release if you pile in months of changes, and this is doubly true for a distributed system with no rigorous testing of the system itself instead of just units
Yes, 100%. That's what I meant by "safer" but thanks for expanding :)
Thx! I'd also like to do more frequent releases, and would especially like a monthly / regular release schedule. It gets difficult for network services like this one, where we have a lot of apps speaking the same language, and then we need to change or remove a bunch of words (IE breaking changes). So this one was mainly pushed back due to the large number of breaking changes, with us wanting to get them all into one release. Otherwise devs would be tearing their hair out every other week accounting for yet another breaking change.
Once the API stabilizes and reaches a
1.0status, breaking changes should be far less frequent, and more frequent releases should be doable.
thats an amazing update, thank you for your hard work. My instance has been updated and Im loving the new user settings
I have noticed something odd, I now dont see posts to local communities in the main feed. is that expected?
You def should... open up an issue on the github with how to create if you would.
Congrats, and thanks for all the hard work! 🍻
Finally 🎉 Love you guys ♥️
Thx!
Congratulations on finally getting this out. The amount of work that went into this release was amazing. Thank you everyone that contributed.
Tremendous news! Looking forward to exploring all the new changes and improvements
Excellent! Hopefully it doesn't break 3rd party apps 🙃
Good thing I have plenty huh?
It doesn't break boost but you have to log out and log in again to be able to comment or post
The ansible instructions have two sections for 0.18.5 and none for 0.19.
The instructions also state ‘ Please regenerate your customPostgres.conf from examples/customPostgres.conf’ but they dont say how to do that
That's meaty. Thanks for all your hard work.
o7
Some of the new features are really neat, thanks!
Many thanks to you, Nutomic, and the several folks contributing in different ways. The effort put in to fix various "papercuts", adding features, and the prompt handling of the security issue earlier this year have been fantastic.
I especially appreciate the consideration that you folks put in to ensure it's pretty straightforward and reliable to host. I've had a few hiccups here-and-there, but nothing a couple of very minor actions haven't been able to fix.
Lemmy's fairly-straightforward architecture has made it fairly easy to troubleshoot issues, and overall, it's one server package I really don't have to worry about or babysit, so thanks for a headache-free experience 😀
Well done and congrats on the big update!
You are awesome! Thanks :D I hope you get to relax this weekend!!
Very nice!
Hooray! There's some really good stuff in this update. Can't wait until my instance upgrades and hopefully it won't break my current apps too much.
Thanks to everyone involved for another big release. There are many great features, but I'm particularly curious about User data export/import.
If someone can import a backup and get access to his data back, does this also mean that some hacker/impersonator can manually craft a backup file and import it to take control of our account ? Interested to know how this works.
It really just exports user-settings related data to a new account, so things like bio, followed communities, saved posts, etc. It can't be used to impersonate you.
What a useful feature! Thank you.
Did 'show read posts' suddenly stop working?
Yes it did, I have a fix out for it now: https://github.com/LemmyNet/lemmy/pull/4297
Any plans to implement "multireddits"? it's currently the issue with the most "thumbs up" on github.
I would like to have "multifeeds" for topics i find more "important", cs career advice and information, open source, etc.
This is especially useful because activity seemed to be spread out among a lot of instances and communities.
once again UTC showing its superiority to timezones good work lemmy team!
I think federation is still broken. I can't see my post on other instances.
Its an issue with outbound federation, we're working on a fix.
Is anyone else seeing super high CPU usage after updating? The docker container seems to spawn a ton of lemmy_server processes, each eating up 50-100% of a core. I don't see anything suspicious in the logs though, it just calmly processes posts.
Very gang! Donate to Lemmy here! --> https://join-lemmy.org/donate
I'm trying to log in on jerboa, first time since the 0.19 update. when I enter my credentials and hit log in, jerboa crashes. any ideas? installed thru fdroid, app is up to date but fdroid says last update 2 months ago. sounds old. maybe fdroid not getting app updates?
Can't wait to block lemmy.world. those darn liberals are harshing my bus
You have the best profile banner I've ever seen btw.
Hahah thanks ive always wondered if anyone ever actually sees it.
