Skip Navigation
Is it possible to run a LLM on a mini-pc like the GMKtec K8 and K9?
  • It's doable. Stick to the 7b models and it should work for the most part, but don't expect anything remotely approaching what might be called reasonable performance. It's going to be slow. But it can work.

    To get a somewhat usable experience you kinda need an Nvidia graphics card or an AI accelerator.

  • BAD PROXMOX UPDATE WARNING
    techhub.social Alex Kretzschmar (@ironicbadger@techhub.social)

    BAD PROXMOX UPDATE WARNING https://forum.proxmox.com/threads/upgrading-pve-tries-to-remove-proxmox-ve-package.149101/page-3

    10
    What's the dumbest blockbuster movie you have seen that somehow received high praise?
  • I haven’t seen them but it might be a callback to early animation.

    To keep costs down and speed up production, cartoons (pre digital animation) would often be animated at around 15 fps, sometimes going as slow as 10 or 12 fps. Each frame was then photographed 2 or 3 times to bring the frame rate up to 24 or 30 fps depending on the media. Robotech, Scooby-Doo, Mighty Max and the original Duck Tales come to mind as examples. Hanna Barbara cartoons were also known for being on the lower end of the spectrum.

  • MicroMac, a Macintosh for Under £5
  • It always amazes me to realize that we now have microcontrollers as powerful as early computers. It one thing to know that a graphing calculator has more computing power than the Apollo spacecraft, another to see it demonstrated like this.

  • What industry do you work in and what are the LPT the general public should know about it?
  • I really wish that were entirely the case. The distances I quoted came from safety trainings I’ve had to take over the years. Given my personal experiences during that time, I think they were from before ABS was mandated. And I had a lot of ABS failures when I was OTR and few close calls as a result of those failures. That’s one of the reasons I chose to switch to running a yard truck 5 years ago. Far less stress.

    When ABS failed on dry pavement and I needed to stop in a hurry, the affected tandem would tend to lock up and bounce along the ground. Nerve racking and scary when there’s traffic in front of you, but not near as bad as on wet or icy roads. The sheer terror of feeling one of my axles start sliding under me.

    If I had one word of advice for drivers new to the industry, it would be to drive as if none of the safety systems on the truck and trailer exist because in my experience they will fail exactly when you need them.

    But when they do work they are f-ing magical.

  • What industry do you work in and what are the LPT the general public should know about it?
  • Some probably do, tech has advanced quite a bit since I started driving in 2008, but the newer tech tends not to be installed widely when it first comes out due to how unreliable tech becomes under the working conditions that are normal in the trucking industry. Fleet owners want their equipment on the road making money, not in the shop costing money, so they tend to wait till a tech proves itself to be reliable. Plus upgrades costs money, so they tend not to happen till a unit is replaced with a newer model, which can take a while.

    Most large companies in the US have an experimental fleet where they try out new tech first, before they roll it out to the rest of their fleets. They are looking for cost effectiveness, reliability and driver response. The smaller owner operators, which make up the bulk of the trucking industry, tend to follow (slowly) after them. And as old as the trucks are, the trailers are often even older. While most trailers in my company's fleet are less than 3 years old right now, the oldest trailer (now mostly used for hauling pallets back to Chep) was built in 1992 according to it's data plate. If it's ABS system is newer then 2008, when it was last active in the fleet I'm a monkey's uncle, and I'd pay long odds it's still the original system from 92.

  • Help for getting started with hardware
  • @tal has already given a really good answer. To add to it, this thread might help you some: https://lemmy.sdf.org/comment/11963996 I was asked what I thought was "better" than a raspberry pi. Came back with an eBay search and a trio of suggestions in the price range of a Pi 4. TLDR is whatever you have currently will probably work fine but if you need to buy hardware, there are plenty of low cost options. And of course, Pi's also work fine for anything they are capable of, which is most things.

    When I started self hosting, Raspberry Pi's were the cheapest option available. I learned fairly quickly that the SD card was the weakest part of them but not long after the Pi3 came out we were able to boot off of USB drives which solved that issue. I think I had 8 SSDs hanging off of one pi before I finally decided to plop down the money for a tower. I then added a pair of 6 port SATA cards and added even more storage to that system. Eventually I was hosting so many things that I was running out of RAM, So I bought a second used tower, this one with a much newer processor and a lot more RAM. Now I run both with the old system running as a NAS and the new system hosting my other services. I wouldn't stress about hardware too much. Hardware can grow with you, to a point.

    Mini PCs are too small to house internal drives

    Most mini PCs I've heard of (and quite a few thin clients) use m.2 drives for internal storage. Not difficult to upgrade. I've also heard of a few that had ports and internal space for 2.5 inch SSDs.

  • What industry do you work in and what are the LPT the general public should know about it?
  • Most of a tractor-trailer's stopping power is split between the trailer brakes and the tractor's drive tandems. If there is not enough weight on those axles, the tires can't grip the pavement properly. If I apply too much power to the brakes the wheels can start bouncing or just lock up and start skidding if the ABS system is acting up.

    Most tractor-trailers you see on the road in the US are designed to weigh 60,000 to 80,000 lbs (~ 27,000 - 36,000 kg). For comparison, a Honda Civic weighs roughly 3,000 lbs (1360 kg). Every system on the truck is designed around moving that amount of mass safely. With an empty dry van trailer your looking at closer to 30,000 lbs (~ 13,000 kg). Makes a difference in performance. Ride is rougher, takes longer to stop.

  • What industry do you work in and what are the LPT the general public should know about it?
  • I’m a truck driver.

    • You are far safer behind me than in front of me. It can take me over two US football fields (200 yards or roughly 180 meters) to come to a full stop and it takes more distance if my trailer is empty. The average car can stop in half that distance. Most cars turn into tin cans when hit by a rig at 25 mph.
    • If you see a number of trucks all moving into the same lane, might consider getting in the same lane, behind us. Odds are pretty good we either saw something in the lane ahead or we heard about something over the CB.
    • I can see you playing on your phone while driving. Cops in some states have been known to hitch rides with truck drivers in order to catch distracted drivers.
    • Learn zipper merging!
  • Music - Self-Host - how to start / what's your stack?
  • I’ve still got a few vintage Napster MP3s from the 56k days.

    Damn, I envy you. I lost all my digital music from those days to disk rot and a hard drive failure. Wish someone told me back then that CD-R was not a good backup medium. Or that I had checked on the disks before I needed them. Live and learn.

  • Music - Self-Host - how to start / what's your stack?
  • I use Jellyfin to stream both video as well as audio. Media is stored on my NAS via a samba share.

    Much like yourself, I’m more frequently streaming music. The default apps aren’t great for music (and horrid for audio books) but there are music specific apps for most iOS, Android, and most PC OSs. Can’t remember what app I use on Linux (don’t use it much) but I use FinAmp on iOS a lot.

    Navidrome is probably a better self hosted music service , but I didn’t see the point when Jellyfin plus FinAmp and met my streaming audio needs.

    As for where I got my music collection, I’m an old fart whose music collection predates digital music. Early stuff was ripped from whatever format it was on to digital a while ago. Nowadays I tend to buy CDs and rip them to flac or buy digital from Band Camp or Amazon.

    I haven’t seen the need since iTunes and Amazon Music came around, but if you wanted to go sailing you can find popular releases and discographies of popular artists on public torrent sites easily enough. There are also several programs available that can take a Spotify playlist and automatically download the music from YouTube.

    While you didn’t ask about audio books, it might help someone else. While I can access my audiobook collection from Jellyfin, it is so bad at audiobooks that that I don’t bother. For audiobooks I use a service called AudioBookshelf. Great for podcasts as well. The audiobooks themselves I generally buy from Audible and then use Libation to strip the DRM.

  • What was your first operating system or Linux Distribution?
  • First OS was DOS (I think) on an Apple IIE at school. I think there were a few Commodore 64’s there as well. A couple years later we got our first home computer running Windows 95. Good times playing Doom, Jane’s Apache, an MS Flight Simulator.

    My first personal computer was running Windows XP and I switched to Ubuntu sometime in 2004. Ran Ubuntu for the most part till a few months ago when I switched my desktop and laptop to NixOS.

    Started self hosting services in 2012 and started with Ubuntu as base OS. Now though most of my servers are Proxmox with the VMs usually running Ubuntu LTS, though NixOS is starting to creep in there as well.

  • Physical Media (Blu-Ray, Music CDs)
  • I do both. I buy the media, usually a physical release, and then put it on my Jellyfin server to stream to my devices. Benefits of streaming, but with the piece of mind that my favorite music, movies or tv shows won’t go away.

  • Does the form factor between 3.5" and 2.5" matter in a NAS server?
  • I don't know of ANY reason to go with spinning-platters, nowadays.

    Price per terabyte is lower on HDDs. For bulk storage they are currently the best path. SSDs are catching up though, and there are cases where a SSD based NAS does make sense. But most folks at home don’t have the network capability to fully utilize their speed. Network becomes the bottleneck.

  • Can You Use Raspberry Pi 5 as a Desktop Computer?
  • Not that I’m aware of.

    The only time I heard anyone talking about it was on the podcast Self-Hosted . Supposedly it’s a NUC clone with performance similar to a then current (2023) mid range laptop and draws about the same amount of power. I think they said the N100 processor had Intel QuickSync for hardware transcoding.

  • Can You Use Raspberry Pi 5 as a Desktop Computer?
  • Sure, but “better” is massively subjective. For me, when I set up a pi, I’m not usually making use of the GPIO or the camera inputs. I’m generally throwing together a headless server. To do that, in addition to the board itself, I need storage, power, heat sinks, an fan and usually some sort of case.

    Using the prices at CanaKit as a rough guide, you can come up with this search on Ebay.

    The first entry I saw drew my attention. It’s a 7th gen i5 with 16GB RAM and a 120 GB SSD. Not sure the 500 GB HDD would survive shipping, but it’s $100 shipped. Biggest concern is that the seller only has 65 sales. Possible scam?

    On the higher end of that bracket there is this. 6th gen and only 8GB RAM, but the seller does have a history.

    With the prices on the Pi5 your potentially getting into the price range where it might make sense to look at the Beelinks mini PCs, based around a 12th gen Intel.

    Like I said, prices right now are at a spot where I can’t just say throw a Raspberry Pi at the problem. They are great boards but for someone self-hosting their own services they don’t necessarily always make sense anymore.

  • What can I make out of a Old Pentium D desktop
  • If you switch the HDD for a pair of SDD (one storage, one swap), it would be somewhat useable. Better to increase the amount of RAM if possible. If I remember correctly, 2-4 GB of RAM was not uncommon at this time period. Although NixOS or a really light Debian install might be able to stay within that amount of RAM. So yea, I think it's feasible.

    Good Idea? Perhaps not so much. That proc has a TDP of 95W. Haven't found anything on it's idle power draw, but I'd guess that that system would have a fairly heavy power draw. The slow speed of the processor and low amount of RAM would probably limit the amount of traffic you could put through it. Additionally, the age of the components would probably cause reliability issues.

    Generally I like to tell folks to use what they have. Repurposing old hardware is better for the environment and usually the wallet, but this system would probably would not be my first, second or even third choice for any workload. I haven't found a benchmark comparing the two, but I think a Pi3 would probably run dead even with this system at a far lower power draw. Although the Pi3's ethernet does run on it's USB bus (I think), along with it's storage, so that would slow it down for this workload. If you wanted to run traffic faster, I would probably look into the used micro PC market at the $75-$150 USD price point. This system is old enough to vote. Something merely 10 years old would be considerably faster.

  • YouTube: Hackers and Crackers by Zearle

    A question here recently brought up memories of listening to this song growing up. Long since lost my copy and had to hear it again. Figured some here might get a trip out it.

    2
    United States | News & Politics @lemmy.ml StrawberryPigtails @lemmy.sdf.org
    Bill to criminalize Alabama librarians for ‘obscene’ content fails in the Senate
    www.al.com Bill to criminalize Alabama librarians for ‘obscene’ content fails in the Senate

    After hours of filibustering from Sen. Rodger Smitherman, the bill was not added to the agenda.

    Bill to criminalize Alabama librarians for ‘obscene’ content fails in the Senate
    4
    United States | News & Politics @lemmy.ml StrawberryPigtails @lemmy.sdf.org
    Woman found living in Michigan grocery store sign, complete with computer and Keurig, for months
    www.nbcnews.com Woman found living in Michigan grocery store sign, complete with computer and Keurig, for months

    The woman had flooring, a computer, a desk, a printer and a Keurig in the rooftop Family Fare sign, police say.

    Woman found living in Michigan grocery store sign, complete with computer and Keurig, for months

    Article may cause a stir, so to avoid a flame war here is the last line in the article.

    > She was not formally charged for living in the space, police said

    24
    Trump can't secure $454 million appeal bond in New York fraud case, his lawyers say
    ground.news Trump can't secure $454 million appeal bond in New York fraud case, his lawyers say

    Donald Trump cannot obtain a bond to secure the $454 million civil business fraud judgment against him as he pursues an appeal of the case, his attorneys said i

    Trump can't secure $454 million appeal bond in New York fraud case, his lawyers say
    36
    What were you listening to in February?

    cross-posted from: https://lemmy.sdf.org/post/13155908

    > What were you listening to in February? > > Post your scribbles! :-)

    31
    Country Music Star Toby Keith Dies at 62
    voxheadlines.com Country Music Star Toby Keith Dies at 62

    Country music singer Toby Keith, known for his chart-topping hits like "Should've Been a Cowboy" and "Courtesy of the Red, White, and Blue," has passed away at the age of 62.

    Country Music Star Toby Keith Dies at 62
    0
    What have you been reading this month?

    This month I've been rereading Halo: Primordium. Good book but just as depressing as I remember. I've also started working my way through the OpenLDAP Admin manual trying to wrap my head around LDAP.

    So what have you all been reading? What did you think of it?

    28
    United States | News & Politics @lemmy.ml StrawberryPigtails @lemmy.sdf.org
    What You Should Know about Eye Drops
    www.fda.gov Eye drop pose a heightened risk of harm

    Eye drops bypass some of the body’s natural defenses, posing a heightened risk of harm to users

    Eye drop pose a heightened risk of harm
    0
    United States | News & Politics @lemmy.ml StrawberryPigtails @lemmy.sdf.org
    Question: Does anyone remember who all the Koch brothers have endorsed for President throughout the years?

    Not trying to start a flame war but it was a question that came to me when I saw that they had just endorsed Nicki Haley for President. It got me wondering who all they had endorsed through the years. I can't remember and Google's not being helpful.

    3
    United States | News & Politics @lemmy.ml StrawberryPigtails @lemmy.sdf.org
    Analysis | Millennials aren’t having kids. Here are the reasons why.
    www.washingtonpost.com Analysis | Millennials aren’t having kids. Here are the reasons why.

    When we investigated why only children remain rare despite plunging birthrates, we instead stumbled upon answers to a bigger mystery.

    Analysis | Millennials aren’t having kids. Here are the reasons why.
    35
    Authentik as a reverse proxy for VS-Code server? How

    I'm currently beating my head up against Authentik. What I'm trying to do is to use Authentik to secure an unsecured service, like VS-Code server. Supposedly I can do this by pointing the domain to the Authentik server and then Authentik's proxy points to the Code Server, but everything that I try either redirects back to Authentik or just gives me a blank screen.

    Authentik and VS-Code are both running on the same system in docker, with my reverse proxy on another system.

    The DNS (pihole) for both code.test and auth.test point to my reverse proxy running Caddy, and all of this is running local network only.

    Any ideas what I am missing? Any help would be appreciated.

    ---------------------------- Caddyfile: code.test.example.com { tls internal reverse_proxy auth.test.example.com } auth.test.example.com { tls internal reverse_proxy 192.168.1.110:9000 } ----------------------------- Authentik Proxy Provider: External host: https://code.test.example.com Internal host: http://192.168.1.110:8443 Internal host SSL Validation = false

    ------------------------------------------ VS-Code Server docker-compose.yaml: version: "2.1" services: code-server: image: lscr.io/linuxserver/code-server:latest container_name: code-server environment: - PUID=1000 - PGID=1000 - TZ=Etc/UTC #- PASSWORD= #optional #- HASHED_PASSWORD= #optional - SUDO_PASSWORD=Password #optional #- SUDO_PASSWORD_HASH= #optional - PROXY_DOMAIN=code.test.example.com #optional - DEFAULT_WORKSPACE=/config/workspace #optional volumes: - ./config:/config ports: - 8443:8443 restart: unless-stopped

    ------------------------------------ Authentik docker-compose.yaml: ``` --- version: "3.4"

    services: postgresql: image: docker.io/library/postgres:12-alpine restart: unless-stopped healthcheck: test: ["CMD-SHELL", "pg_isready -d $${POSTGRES_DB} -U $${POSTGRES_USER}"] start_period: 20s interval: 30s retries: 5 timeout: 5s volumes: - database:/var/lib/postgresql/data environment: POSTGRES_PASSWORD: ${PG_PASS:?database password required} POSTGRES_USER: ${PG_USER:-authentik} POSTGRES_DB: ${PG_DB:-authentik} env_file: - .env redis: image: docker.io/library/redis:alpine command: --save 60 1 --loglevel warning restart: unless-stopped healthcheck: test: ["CMD-SHELL", "redis-cli ping | grep PONG"] start_period: 20s interval: 30s retries: 5 timeout: 3s volumes: - redis:/data server: image: ${AUTHENTIK_IMAGE:-ghcr.io/goauthentik/server}:${AUTHENTIK_TAG:-2023.8.3} restart: unless-stopped command: server environment: AUTHENTIK_REDIS__HOST: redis AUTHENTIK_POSTGRESQL__HOST: postgresql AUTHENTIK_POSTGRESQL__USER: ${PG_USER:-authentik} AUTHENTIK_POSTGRESQL__NAME: ${PG_DB:-authentik} AUTHENTIK_POSTGRESQL__PASSWORD: ${PG_PASS} volumes: - ./media:/media - ./custom-templates:/templates env_file: - .env ports: - "${COMPOSE_PORT_HTTP:-9000}:9000" - "${COMPOSE_PORT_HTTPS:-9443}:9443" depends_on: - postgresql - redis worker: image: ${AUTHENTIK_IMAGE:-ghcr.io/goauthentik/server}:${AUTHENTIK_TAG:-2023.8.3} restart: unless-stopped command: worker environment: AUTHENTIK_REDIS__HOST: redis AUTHENTIK_POSTGRESQL__HOST: postgresql AUTHENTIK_POSTGRESQL__USER: ${PG_USER:-authentik} AUTHENTIK_POSTGRESQL__NAME: ${PG_DB:-authentik} AUTHENTIK_POSTGRESQL__PASSWORD: ${PG_PASS} # user: root and the docker socket volume are optional. # See more for the docker socket integration here: # https://goauthentik.io/docs/outposts/integrations/docker # Removing user: root also prevents the worker from fixing the permissions # on the mounted folders, so when removing this make sure the folders have the correct UID/GID # (1000:1000 by default) user: root volumes: - /var/run/docker.sock:/var/run/docker.sock - ./media:/media - ./certs:/certs - ./custom-templates:/templates env_file: - .env depends_on: - postgresql - redis

    volumes: database: driver: local redis: driver: local

    6
    InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)ST
    StrawberryPigtails @lemmy.sdf.org
    Posts 20
    Comments 216