Over the last year, AI has become a popular topic. Some is hype, some is substance. Some is good, some is bad. We want to give you the good, not the bad, and ignore the hype!
In Nextcloud Hub 4 and 5, we’ve focused on providing you the best tools that AI has to offer. Benefits like improving your work productivity and jump starting creativity, AI features can enhance your Nextcloud experience.
To fit everyone’s needs, we offer several types of integrations for AI, from completely self-hosted options to integrations with external services.
If you’re interested in setting up Nextcloud’s AI features on your instance, then keep reading for a breakdown of how to enable and use each one! 💙
Self-hosted vs. integrations from external services
First, let’s understand the difference between self-hosted AI features versus integrations from external services.
All self-hosted AI features are built-in and only run on YOUR server, meaning no data leaves your premises and you’re in full control. Our self-hosted options can be installed from the Nextcloud App Store. Some are built-in and some require some command line commands to be run to download Ai models.
We also offer AI features using remote AI services from companies like DeepL and OpenAI (ChatGPT and DALL·E). These features can be enabled on your server but data from the app is sent to the third party. Note that nothing is ever sent to external services by default unless you explicitly enable those features or install the related apps. However, if you like these services, then they are available to you!
Ethical AI Rating
For some use cases, tools like ChatGPT might be a reasonable solution, while for other data, it is paramount to have a local, on-prem, open solution. To differentiate these, we developed an Ethical AI Rating.
For every AI feature that Nextcloud supports, a rating is established. This shows you the risks you take with your data is when using a feature and it gives you a quick insight into the ethical implications of your choice.
Based on these conditions:
✅
Is the software open source? (Both for inferencing and training)
✅
Is the trained model freely available for self-hosting?
✅
Is the training data available and free to use?
The rating has four levels:
Green 🟢
All conditions are met
Yellow 🟡
2 conditions are met
Orange 🟠
Only 1 condition is met
Red 🔴
No conditions are met
Now, let’s learn about Nextcloud’s AI features, their rating and how to enable and use them!
About LocalAI
LocalAI is an open source API that allows you to set up and use many AI features to run locally on your server. However instead of connecting to the OpenAI API for these, you can also connect to a self-hosted LocalAI instance with the Nextcloud LocalAI integration app.
Your cloud is full of photos, but sometimes the image you need isn’t there. Maybe it is somewhere on the web, or maybe you can only visualize it in your head? With AI image generation, you can type in keywords to create the image you’re imagining. Your instant AI generated image can be inserted into a Talk chat, Notes and much more.
3 options to generate images:
Online StableDiffusion based generator via Replicate’s remote API – Yellow rating 🟡
Self-hosted StableDiffusion using the OpenAI app- Yellow rating 🟡
To use OpenAI’s DALL·E 2 images or the on-premises StableDiffusion based generator, just install the OpenAI integration app. You can find instructions to get the model in the settings!
This feature is very versatile on Nextcloud, being able to insert an AI generated image in a document, Talk chat and more. To use this feature in your Nextcloud, open up the Smart Picker by typing a slash (/) in your document, Talk chat and more!
2. Text generation
How do you craft intelligent, professional text? With the text generating tool in Nextcloud Talk, Office and Mail of course!
For the on-premises option, you also install the OpenAI app to communicate with a self-hosted instance of LocalAI which can run language models to generate text. See instructions.
To use OpenAI’s ChatGPT, install the OpenAI integration app.
Sometimes, it’s easier to say something out loud. With Nextcloud’s speech-to-text dictation feature, you can formulate text through your voice. Use your spoken words to send a message in a Nextcloud Talk chat, in an email and through many more applications.
The on-premises version can be enabled with the OpenAI app. In your Nextcloud settings, configure the OpenAI integration app to use your self-hosted Local AI instance.
The external service integration option utilizes Whisper, as seen below.
4. Speech-to-text transcription
In the speech-to-text transcription feature, your call recordings can be automatically transcribed. This smart feature is great for recording what was said during important meetings for your record keeping.
How to enable: Green rating🟢
If the OpenAI integration is installed and configured (using either OpenAI or LocalAI), Talk will be able to automatically produce speech-to-text transcriptions of call recordings. You will receive a transcription file just like the video recording file right after the recorded call ends.
5. Smart Inbox in Mail
Now let’s talk about our smart feature in Mail. Nextcloud Mail uses Machine Learning (ML) to classify the importance of incoming emails based on your historical data and pattern recognition. This provides you a priority inbox, where your most important messages are at the top. Due to the ML technology, your data never leaves the server.
How to enable: Green rating🟢
Luckily for you, this feature is already integrated by default. However, if you want to disable it at any time, you can do so in the bottom left settings of the Mail app.
Join our upcoming Nextcloud webinar and learn to tap into the power of AI while safeguarding and controlling your data!
In your Nextcloud Photos, you can quickly find people, places or objects when using the Recognize app. Recognize goes through your media collection and adds fitting tags which automatically categorize your photos, and even music!
The way Recognize works is through training an artificial neural network that recognizes patterns which yields the results we see. You can learn more about how the app works and facial recognition technology in the blog.
How to enable:
To get face recognition in your Nextcloud, install the Recognize app in the Nextcloud App Store.
“This app is incredible! It works really well. Very easy to set up. It takes a long time for the first recognition, but man, is it worth it! I expected face recognition working well, but I did not expect the tags feature working very well also! It created tags I did not think is possible. Super useful!”
Before joining a video call, you have the opportunity to change your background to an image of your choice or add a blur effect. It so happens that this blur “effect” is actually a complex computing contouring that uses Machine Learning (ML). Nextcloud uses the Jitsu library and a model called MediaPipe (both open source) to create this effect.
How to enable: Green rating🟢
This feature is ready to be used once you’ve installed Hub 5.
8. Translation tools
In today’s connected world, you’re bound to be put in a situation where you need to translate a message, word or piece of text in another language. Now you can translate anything with Nextcloud!
Local translation – Green rating 🟢
Nextcloud provides a translation service app that runs locally on your server. Using open source Opus models by University of Helsinki in Finland, you can rest assured no data can leak.
Use local translation in Nextcloud Talk to translate a message in a chat or in a Text document.
Witness how your writing can be instantly translated in Nextcloud Text.
How to enable:
Enable local translation by installing the Translate app! Languages supported are: English, German, French, Spanish and Chinese so far.
You also have the option to use the external service integration DeepL. DeepL is a popular translator based in Germany that provides translations in 29 different languages.
DeepL receives a red rating because they use proprietary models and the app connects to their website. Since DeepL is a separate service, data put into this model on your server will be sent to them. Take care to read about DeepL’s privacy protocols and what they do with your data.
Suspicious login detection detects and warns you about suspicious IPs logging into your Nextcloud.
This feature works through learning your behavior of logins – when and where – so if a suspicious login occurs, you’ll be notified in time to change your password or upgrade your security controls.
How to enable: Green rating🟢
Suspicious login detection was once an app, but now it is integrated right into your instance. Just go to your admin settings and click on security. As always, the feature can be enabled or disabled per your preference.
Join our upcoming Nextcloud webinar and learn to tap into the power of AI while safeguarding and controlling your data!
Organisations, small and large, need a way to ensure the resiliency and digital sovereignty of their operations – an open-source, privacy-respecting alternative to Teams. And today, we present that solution - Nextcloud Talk.
Nextcloud has been recognized with the World Summit Award Germany that selects and promotes local digital innovation improving society, aiming to contribute to the United Nations' agenda of sustainable development goals.
Nextcloud Hub 9 lets you stay connected. Discover new federation features, workflow automation, big design overhaul and much much more in your favourite open-source collaboration platform!
DIE ZEIT, a prominent German outlet, interviewed Nextcloud’s founder Frank Karlitschek for an article on Microsoft’s anti-competitive behaviour on the European office software market. Read for a recap of the article and the key takeaways.
MagentaCLOUD’s migration to Nextcloud in 2021 resulted in a fully equipped Online Storage with an integrated online office suite that further improves the user experience, flexibility and security for customers.
We bring you a major update to the Nextcloud AI Assistant, plus the news we work with several big hosting providers like IONOS and OVHcloud to bring AI-as-a-Service options to you!
Bechtle and Nextcloud announce today a complete managed collaboration platform for the public sector that requires no tender and can be deployed immediately.
Discover how to make the switch from ownCloud to Nextcloud. Our quick guide provides insights into the migration process, helping you make the transition smoothly.
Today, US-based file sync & share vendor Kiteworks announced their acquisition of ownCloud and Dracoon. Kiteworks points out that their customers now have access to their file-sharing application. It is to be expected they will not maintain 3 similar products, but customers will have to migrate to the US firms’ platform or look for another […]
As part of Schleswig-Holstein's state digitization strategy, the state chancellery has announced they will work with Nextcloud to develop AI for working with government documents. This comes just after we announced the first private AI assistant last weekend with Hub 6. The German state already uses Nextcloud and their AI strategy aligns with our work on ethical, local AI technologies.
In this article, we find out how open-source AI gets you your privacy back and explore examples of reliable AI models that you can use in your ecosystem.
In this article, we explain how federation works and what federation tools you can already use in Nextcloud, and discover how it can help businesses and governments achieve digital sovereignty.
We save some cookies to count visitors and make the site easier to use. This doesn't leave our server and isn't to track you personally!
See our Privacy Policy for more information. Customize
Statistics cookies collect information anonymously and help us understand how our visitors use our website. We use cloud-hosted Matomo
Matomo
_pk_ses*: Counts the first visit of the user
_pk_id*: Helps not to double count the visits.
mtm_cookie_consent: Remembers that consent for storing and using cookies was given by the user.
_pk_ses*: 30 minutes
_pk_id*: 28 days
mtm_cookie_consent: 30 days