That is awesome! This is why Lemmy is the best social media site. Thanks @reddig33@lemmy.world for the resource!
In the words of Ubisoft we need to feel "comfortable with not owning your game". If buying is not owning then piracy is not stealing.
Got any recommended resources for piracy sites/lists?
Vsauce is awesome! He makes you question everything after each video!
Also...
What free resources do you know on the internet that everyone should use?
Potential Category Ideas
- FOSS Software
- Quality of Life
- Public Services
- Other List of Lists
- Personal Finance
- Github Awesome Repositories
- Firefox Addons
- Free Research/Books
- Piracy Sites & Lists
- Real Life Resources
Links and Resources
Some of my favorites are from Edward Frenkel and the Langlands Program. In analogy the Langlands Program can be thought of as the "Theory of Everything" of mathematics linking various seemingly disconnected fields together.
Another great video is from 3b1b where he shows Pi somehow emerge from 2 blocks colliding against each other.
Links & Resources
What are your favorite mathematics channels/videos on YouTube?
There are tons of great videos on YT, but I'll list some resources from 3Blue1Brown's SoME3 contest if you want to discover more math explainers.
SoME3 Resources
- YouTube - 25 Math explainers you may enjoy
- YouTube - SoME3 424 Video Playlist
- 3Blue1Brown - Summer of Math Exposition (Non-videos)
This is a continuation to my original "What are the most mindblowing things in mathematics?" post.
Additional Resources
Please solve the partial differential equation to continue watching the video:
"I am not a robot" captcha is getting too hard...": https://www.youtube.com/watch?v=ru6fi4O4lp4
Your comment belongs higher. When given the opportunity to make money by social media advertising sometimes in the thousands or millions, companies, share holders, and conflict of interest groups take it. Cablemod's burning adapters, cryptocurrency scams, payed positive youtube reviews are some great examples. In general there is no honor system and its best to assume anything that can be abused will.
Also manipulating votes is incredibly effective towards swaying public opinion due to the bandwagon effect. Spend a days worth of effort making fake accounts and downvoting any opinion you see as undesirable and most people will follow suit. This is especially bad in echo chambers like on twitter, reddit, etc.
I wish a broader audience could be aware of this. The best I can do is try to spread the word.
Sources:
- The Problem with Linus Tech Tips: Accuracy, Ethics, & Responsibility: https://www.youtube.com/watch?v=FGW3TPytTjc
- Cablemod Recall: https://old.reddit.com/r/cablemod/comments/18o7bnv/planned_voluntary_safety_recall_of_cablemod/
- FTX Scandal: https://en.wikipedia.org/wiki/Bankruptcy_of_FTX
- Bandwagon Effect: https://en.wikipedia.org/wiki/Bandwagon_effect
- Echo Chamber: https://en.wikipedia.org/wiki/Echo_chamber_(media)
Same! And lemmy has provided the highest quality answers on the internet in my opinion.
Self hosting is smart! Usually good things always come to an end, at least if they are not open sourced.
Due to how important search is, it is not a stable solution to place the trust of the technology, your data privacy, and fair pricing to a corporation. Kagi so far seems great don't get me wrong! But enshitification from monetary incentives almost always occur. Open source search is the only stable long term solution.
The Patriot Act and Snowden's leaks have shown companies will go against their privacy policy to appease governments. Search engines especially are targeted by five eyes with the PRISM program where copies of all your data, linked to your payment, are sent to Five Eyes and stored. Gag orders and legal threats prevent disclosure, as has been done with prior tech companies who have tried to push back against this.
Be wary of trusting corporations with your data as monetization is a powerful incentive.
Valve is great! Private and non-profit organizations give me some hope for a better internet one day.
Regarding Kagi, there are other potential concerns with privacy, data leaks and price gouging as well. The Patriot Act and Snowden's leaks have shown that companies will lie in their privacy policy to appeal to authorities even if they claim they are not storing information. All your health related searches, sensitive personal details, private life, etc is also always linked to your payment method waiting for a potential data leak if they are lying. (Or a copy is just sent to five eyes)
All that is to say, be wary of trusting your privacy to companies. Monetization is a powerful motivator!
I'm worried eventually even Kagi will get enshittified. It has been a common trend that almost always occurs. Open source is the only way to ensure stability. Conflict of interest is what leads to companies either overcharging, or even accepting to get bought out.
Don't get me wrong, Kagi seems to be a great company thus far! But for something as important as search it would be best to have an open source solution.
Hmm, I did notice a sudden severe drop in quality recently. Perhaps they are A/B testing something.
Conflict of interest is the best explanation. The goal of search engine companies is not to provide information as efficiently as possible but rather something else entirely.
A lack of competition is another factor as well with the monopolization of Google, Microsoft, etc. There may exist better search engines, but the average joe, and even some of us, have trouble finding them. The quality search engines don't get a chance to expand and or are bought out like with Altavista (Regarded as the best search engines from the golden age). For example, crowdview.ai is the best search engine (outside of kagi from what I've heard) but I'm unsure if they will be able to stay afloat for a long enough time to get a chance to expand and take shots at Google.
The enshitification has been a gradual process. Think of it as slowly boiling a frog. I've observed the quality of search slowly degrading over the past 2 decades. Just recently, it has gotten to such a severe point that searching has been useless.
Altavista was ahead of their time. The modern internet desperately needs a technical search engine.
I've heard a lot of great things about Kagi, though the search limit and subscription is a little off-putting. A self-hosted Kagi would be amazing though!
It is becoming near impossible to find relevant information from search engines. Duckduckgo, SearXNG, Bing, Google, and so many more mainstream engines have a significantly high noise to signal ratio, and it is getting worse.
Here are a collection of the best search engines I know, please add more to the list.
- Forum Search Engine: https://crowdview.ai/
- Non-commercial Search: https://search.marginalia.nu/
- Libre Meta Search Engine: https://librey.devol.it/
- Golden Age Search Engine: https://www.wiby.org/
- Yandex: https://yandex.com/
If no more high quality search engines exist, would it be possible to host your own?
EDIT: Some new discoveries. The addon uBlacklist and filters can block super SEO sites from appearing in search.
- https://addons.mozilla.org/en-US/firefox/addon/ublacklist/
- https://github.com/rjaus/awesome-ublacklist
- https://github.com/NotaInutilis/Super-SEO-Spam-Suppressor
It is becoming near impossible to find relevant information from search engines. Duckduckgo, SearXNG, Bing, Google, and so many more mainstream engines have a significantly high noise to signal ratio, and it is getting worse.
Here are a collection of the best search engines I know, please add more to the list.
- Forum Search Engine: https://crowdview.ai/
- Non-commercial Search: https://search.marginalia.nu/
- Libre Meta Search Engine: https://librey.devol.it/
- Golden Age Search Engine: https://www.wiby.org/
- Yandex: https://yandex.com/
If no more high quality search engines exist, would it be possible to host your own?
EDIT: Some new discoveries. The addon uBlacklist and filters can block super SEO sites from appearing in search.
- https://addons.mozilla.org/en-US/firefox/addon/ublacklist/
- https://github.com/rjaus/awesome-ublacklist
- https://github.com/NotaInutilis/Super-SEO-Spam-Suppressor
Feel free to post multiple suggestions for different genres. For example, atmospheric, sci-fi, adventure-like, etc.
I wanted to make this post so we can share all the resources we have with each other on anything machine learning related.
Please feel free to add all of your resources as well even if they are duplicates.
PS: The best way to grow our lemmy community is to produce high quality posts.
Some ideas of things you could share:
- What people do you follow for AI? Such as on YT, Twitter, etc.
- What other social media forums provide great information?
- What GUI do you use for local LLMs?
- What parameters are "best"?
- Is there a Wiki you use?
- Where do you go to learn about LLMs/AI/Machine Learning?
- How do you find quality models?
- What Awesome github repositories do you know?
- What do you think would be useful to share?
General Information - Awesome
- Awesome-LLM: https://github.com/Hannibal046/Awesome-LLM
- Awesome Jailbreaks: https://github.com/0xk1h0/ChatGPT_DAN
- Awesome Prompts: https://github.com/f/awesome-chatgpt-prompts
- Prompt-Engineering-Guide: https://github.com/dair-ai/Prompt-Engineering-Guide
- AI Explained (Great channel for AI news): https://piped.video/channel/UCNJ1Ymd5yFuUPtn21xtRbbw
- Lex Fridman (In depth podcasts): https://piped.video/channel/UCSHZKyawb77ixDdsGog4iWA
LLM Leaderboards:
- LLM Logic Tests: https://docs.google.com/spreadsheets/d/1NgHDxbVWJFolq8bLvLkuPWKC7i_R6I6W/edit#gid=2011456595
- llm-leaderboard: https://github.com/LudwigStumpp/llm-leaderboard
- Chat leaderboard: https://chat.lmsys.org/?leaderboard
- Gotzmann LLM Score v2.4: https://docs.google.com/spreadsheets/d/1ikqqIaptv2P4_15Ytzro46YysCldKY7Ub2wcX5H1jCQ/edit#gid=0
- LLM Worksheet: https://docs.google.com/spreadsheets/d/1kT4or6b0Fedd-W_jMwYpb63e1ZR3aePczz3zlbJW-Y4/edit#gid=0
- CanAiCode Leaderboard: https://huggingface.co/spaces/mike-ravkine/can-ai-code-results
- AlpacaEval Leaderboard https://tatsu-lab.github.io/alpaca_eval/
- Measuring Massive Multitask Language Understanding: https://github.com/hendrycks/test
- Awesome-LLM-Benchmark: https://github.com/SihyeongPark/Awesome-LLM-Benchmark
Places to Find Models
- Discovery the LLMs: https://llm.extractum.io/
- Open LLM Models List: https://github.com/underlines/awesome-marketing-datascience/blob/master/llm-model-list.md
- OSS_LLMs: https://docs.google.com/spreadsheets/d/1PtrPwDV8Wcdhzh-N_Siaofc2R6TImebnFvv0GuCCzdo/edit#gid=0
- OpenLLaMA: An Open Reproduction of LLaMA: https://github.com/openlm-research/open_llama
- open-llms: https://github.com/eugeneyan/open-llms
Training & Datasets
- Uncensored Models: https://erichartford.com/uncensored-models
- LLMsPracticalGuide: https://github.com/Mooler0410/LLMsPracticalGuide
- awesome-chatgpt-dataset: https://github.com/voidful/awesome-chatgpt-dataset
- awesome-instruction-dataset: https://github.com/yaodongC/awesome-instruction-dataset
There are still many more resources out there I'm sure. Please share what you use to try to keep up with the fast pace of AI development.
I hope some of my resources have helped you! I'm eager to hear what other resources are out there!
What concepts or facts do you know from math that is mind blowing, awesome, or simply fascinating?
Here are some I would like to share:
- Gödel's incompleteness theorems: There are some problems in math so difficult that it can never be solved no matter how much time you put into it.
- Halting problem: It is impossible to write a program that can figure out whether or not any input program loops forever or finishes running. (Undecidablity)
The Busy Beaver function
Now this is the mind blowing one. What is the largest non-infinite number you know? Graham's Number? TREE(3)? TREE(TREE(3))? This one will beat it easily.
- The Busy Beaver function produces the fastest growing number that is theoretically possible. These numbers are so large we don't even know if you can compute the function to get the value even with an infinitely powerful PC.
- In fact, just the mere act of being able to compute the value would mean solving the hardest problems in mathematics.
- Σ(1) = 1
- Σ(4) = 13
- Σ(6) > 101010101010101010101010101010 (10s are stacked on each other)
- Σ(17) > Graham's Number
- Σ(27) If you can compute this function the Goldbach conjecture is false.
- Σ(744) If you can compute this function the Riemann hypothesis is false.
Sources:
- YouTube - The Busy Beaver function by Mutual Information
- YouTube - Gödel's incompleteness Theorem by Veritasium
- YouTube - Halting Problem by Computerphile
- YouTube - Graham's Number by Numberphile
- YouTube - TREE(3) by Numberphile
- Wikipedia - Gödel's incompleteness theorems
- Wikipedia - Halting Problem
- Wikipedia - Busy Beaver
- Wikipedia - Riemann hypothesis
- Wikipedia - Goldbach's conjecture
- Wikipedia - Millennium Prize Problems - $1,000,000 Reward for a solution
An Internet Portal is an information hub connecting you a much wider portion of the internet.
For example:
- Wikipedia's Content Portal: https://en.wikipedia.org/wiki/Wikipedia:Contents/Portals
- Github's List of Awesome: https://github.com/topics/awesome
- Wikipedia's List of list of lists: https://en.wikipedia.org/wiki/List_of_lists_of_lists
- Wikipedia Internet Forums List: https://en.wikipedia.org/wiki/List_of_Internet_forums
What Internet Portals do you know of that you would like to share?
Search engines have been dropping in quality significantly within the past decade, and especially within this past year. The noise to signal ratio has been frankly painful.
Can you please share some resources you use when trying to find answers to technical questions?
For example, STEM, academia, engineering, programming, etc.
What social media platforms do you use and want to recommend to others? Front ends could also be a suggestion, along with lists of great communities.
For example: https://sub.rehab/
Which is a collection of communities from different platforms.
The quality of search engines has gone down so much for technical questions.
I'm looking for a way to index sites like stack exchanges, reddit, quora, and research papers. Would this be possible to do this locally with metadata?
Leaderboard scores often can be a bit misleading since there are other factors to consider.
- Censorship: Is the model censored?
- Verbosity: How concise is the output?
- Intelligence: Does the model know what it is talking about?
- Hallucination: How much does the model makes up facts?
- Domain Knowledge: What specialization a model has.
- Size: Best models for 70b, 30b, 7b respectively.
And much more! What models do you use and would recommend to everyone?
The model that has caught my attention the most personally is the original 65b Llama. It seems genuine and truly has a personality. Everyone should chat with the original non-fine tuned version if they can get a chance. It's an experience that is quite unique within the sea of "As an AI language model" openai tunes.
SEO has made it incredibly hard to find answers without getting spammed by news and blog sites. Places like ask Lemmy help democratize answers through upvotes and downvotes so the quality is higher.
Do you know of any hidden gems for search engines or Q&A sites that contain highly relevant answers without much noise?
Feel free to list a few video games from different genres. Best is definitely subjective and I'm sure there are many "Best" games for various categories.
Half Life: Alyx for example is widely considered the "Best" VR game. Many would agree it's the best Action VR game, but it wouldn't be the "Best" for puzzles.
To make it easier I'll list the types of Genres for Video Games from Wikipedia. Please do give suggestions for some of the highest quality games you've played from various categories:
- Action: Platform games, shooter, fighting, survival, etc
- Action-Adventure: Survival horror
- Adventure: Interactive, real time, 3d, text adventures, etc
- Puzzle: Exploration, trial and error, breakout, logical games, etc
- Role-playing: Action RPG, MMORPG, tactical, sandbox, etc
- Simulation: Management, life simulation, vehicle simulation, etc
- Strategy: Real time, turn based, wargame, grand strategy, etc
- Sports: Racing, competitive, sports games, etc
- MMO: Massively multiplayer online game
- Openworld: Sandbox, creative, open world, etc
Note: Non-exhaustive category list. There are more such as card games, board games, etc. Please check the wiki link above for more categories to get ideas for the "best" games.
I personally would recommend Subnautica (Open World), Half Life: Alyx (VR Action-Adventure), The Witcher 3 (Role-playing), Black Mesa (Action), Titanfall 2 (Action), Portal 2 (Puzzle), Battlebit (MMO/Action), and Half Life 3 (Fictional Game).
As an alternative if you have suggestions for documentary sources please do share them.
Mine would be United States of Secrets by PBS Frontline.
LEMMiNO is also great! One of the best documentary makers ever!
As an alternative if you know any good list of RSS feeds please do share them!
I'll start with one of the most useful singular list of lists on the internet.
https://github.com/topics/awesome
"An awesome list is a list of awesome things curated by the community. There are awesome lists about everything from CLI applications to fantasy books. The main repository serves as a curated list of awesome lists."
Just about anything you can think of is within this list. Enjoy!
PS: Thank you mods for your work moderating submissions. The quality and relevance of posts here is refreshing. This has to be my favorite community on Lemmy.
Asklemmy has been a great place for information and resources. What are other some great resources everyone should know?
Kiwix is my recommendation. https://www.kiwix.org