Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
social.tchncs.de is one of the many independent Mastodon servers you can use to participate in the fediverse.
A friendly server from Germany – which tends to attract techy people, but welcomes everybody. This is one of the oldest Mastodon instances.

Administered by:

Server stats:

3.8K
active users

social.tchncs.de: AboutProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.7

#ondeviceai

0 posts0 participants0 posts today
Public
utzer [Pleroma]
Can I run an #Apple (M3/M4) machine headless to experiment with local #LLMs?

What I want to achieve:
🎙️ Audio transcription
📝 Automatic summarization + minutes of meeting generation
🌐 Ideally with a local web-based GUI

Requirements:
✅ Full use of Apple Silicon performance (M3/M4)
✅ Headless setup
✅ Support for different open-source LLMs

Are there any existing solutions or projects that match this use case?
Any tips or experiences welcome!

#AppleSilicon #OnDeviceAI #LLM #OpenSource #AI #SelfHosted #EdgeAI #PrivateAI
#privateai
Public
utzer [Pleroma]
Kann ich einen #Apple-Computer (M3/M4) headless betreiben, um darauf lokal ein paar #LLMs laufen zu lassen?

Ziel:
🎙️ Audio-Transkripte erstellen
📝 Automatische Zusammenfassungen & „Minutes of Meeting“
🌐 Idealerweise via Web-GUI im lokalen Netzwerk erreichbar

Wichtig:
✅ Volle Ausnutzung der Apple-Hardware (M3/M4)
✅ Headless-Betrieb
✅ Unterstützung verschiedener freier LLMs

Gibt es dafür schon eine brauchbare Lösung oder Projekt? Erfahrungen?

#LLM #AppleSilicon #OnDeviceAI #OpenSource #Techfrage #AI #KI
#ki
Public
ObjectBox

Cloud AI is revolutionizing industries, but what about all the settings where you have no or low connectivity? The answer is 𝐋𝐨𝐜𝐚𝐥 𝐀𝐈.

Thanks to rapid advancements in (Large) lAnguage models, there are more and more poerful 𝐒𝐦𝐚𝐥𝐥 𝐋𝐚𝐧𝐠𝐮𝐚𝐠𝐞 𝐌𝐨𝐝𝐞𝐥𝐬 and with ObjectBox also a lightweight, fast and energy-efficient 𝐥𝐨𝐜𝐚𝐥 𝐯𝐞𝐜𝐭𝐨𝐫 𝐝𝐚𝐭𝐚𝐛𝐚𝐬𝐞.

Read about Local AI - what it is and why we need it here:

objectbox.io/local-ai-what-it-

#localAI#EdgeAI#ondeviceAI
Public
R.J. Faas

Neural Engine equivalents coming to Windows PCs this year

There’s one AI area where Apple has led the way: on-device AI processing using the Neural Engine in its iPhone, iPad, and Mac. Market intelligence company says it expects Windows PC brands to follow Apple’s lead this year, putting their own equivalent of Neural Engine chips in high-end laptops this year.

#Apple #AI #NeuralEngine #ondeviceAI #machinelearning #ML #Microsoft
9to5mac.com/2024/01/11/windows

9to5Mac · Neural Engine equivalents coming to Windows PCs this yearWhile critics might say Apple is falling behind in the AI race, there’s one area where the Cupertino company has...
Public
Norobiik @Norobiik@noc.social

"Nvidia and Microsoft are taking advantage of Windows’ ability to run the #Linux operating system. The so-called Windows Subsystem for Linux (#WSL) used to be a hassle to install, but Microsoft has been streamlining the process.

Nvidia now says it’s been working to deliver 'GPU acceleration and support' for the company’s entire AI software stack inside WSL." #OnDeviceAI

#Nvidia, #Microsoft Open the Door to Running #AI Programs on #WindowsPCs | PCMag
pcmag.com/news/nvidia-microsof

An image showing a chip with AI workloads running on it. A Microsoft and Nvidia logo are under the chip image. (Credit:Nvidia)
ExploreLive feeds
About