Remember Nextcloud 11? This release resulted in the TU Berlin cutting their database load in half upon migration and while this performance advantage is yet unmatched, the upcoming 13 is slated to introduce its own slew of improvements. The story starts with LDAP returning user information over 85% faster in a torturous test we devised; and continues with improvements to our external storage capabilities giving system administrators employing php-smbclient for their Windows Network Drive a 10x speedup in sequential read/write to look forward to. There is more and we encourage you to read on but, perhaps most importantly, download the beta and give it some in depth testing! Open Source software is only as good as its numerous contributors and no test matrix can replicate what you lot throw at our software every single day. Testing Nextcloud 13 Beta 1 against your unique requirements is what will ensure its ultimate stability and usability, so give it a good run!
First awesomeness: LDAP
For Nextcloud 13, we’ll introduce a small but very nice feature: auto-complete of user names in the comments field. Here’s a video for you to enjoy the results, made by Arthur, its principal author.
For this feature to work well, it is important to get a list of matching users to the browser as quickly as possible. On enterprise installations, this typically means going through the LDAP code in Nextcloud, ultimately checking with the LDAP server what users match the name you’re typing. You can probably imagine that with 150.000 users, this isn’t as snappy as on your home server with 5 users!
Consequently, this area needed work. A torture test was devised: setup a server with 150.000 users and ask it for users 1001 to 1500 that match the characters “ha”. This took a whole 15.2 seconds before the work started, making auto-complete in the share or comments dialogs less than fun. However, after the work was done, reviewed and merged, this same action took no more than 1.8 seconds! This will only work if the users have been fetched before at least once but on a running, busy, active server, the impact of this change should be noticeable very quickly.
Stay tuned for a post about the work on this by Arthur on his blog!
Besides some small improvements (like the addition of a save button for LDAP user credentials to avoid issues with browser auto-complete), another major change was integrated: a plugin mechanism which allows users to extend the Nextcloud LDAP features. Normally, Nextcloud does not require an LDAP server to give it write access, something security-conscious administrators appreciate. But sometimes it would just be darn useful to manage LDAP users from within Nextcloud and with this plugin structure, this would now be possible. An application to do some of this work was developed by the contributor of this code and while it is specific for a certain LDAP structure its code can certainly serve as an example for others.
Storage, Encryption and more
Our external storage code has seen optimizations as well. The load on the database was reduced for all external storage folders and as mentioned before, systems using php-smbclient to provide access to a Windows Network Drive or Samba share will see an improved sequential read/write speed of up to 10x! S3 external storage reduced its CPU load by 50% and its execution time by 73% (that means “it is almost 4x as fast with small files”), in addition to adding the ability to handle large files. It was previously limited to files about 5GB in size.
Our Server-side Encryption has been sped up as well, at least on new installations. Until now, per-user keys were used by default and administrators could enable the master key. This is now enabled by default, resulting in a significant speedup, while also working better when users are provisioned over LDAP and change their passwords. The change helps especially with large folders and makes group sharing instant. Login resets also work faster and easier. We recommend administrators to switch from per-user to master key encryption when enabling encryption to benefit from this performance improvement as well. Unfortunately existing installations can not switch over without disabling encryption, decrypting files, and re-enabling encryption.
There is more: search was improved, especially for large searches on large servers, reducing database load and runtime. The Contacts app loads large numbers of contacts much faster and deferred script loading in the browser was shown to decrease time it takes for the first page loading our files app by more than 50%!
This release was developed by the wonderful Nextcloud community and we’d like to thank every single person involved for their help in making this happen! If you’d like to be part of the team that makes the best, most awesome private cloud technology in the world, join us!
Today, US-based file sync & share vendor Kiteworks announced their acquisition of ownCloud and Dracoon. Kiteworks points out that their customers now have access to their file-sharing application. It is to be expected they will not maintain 3 similar products, but customers will have to migrate to the US firms’ platform or look for another […]
As part of Schleswig-Holstein's state digitization strategy, the state chancellery has announced they will work with Nextcloud to develop AI for working with government documents. This comes just after we announced the first private AI assistant last weekend with Hub 6. The German state already uses Nextcloud and their AI strategy aligns with our work on ethical, local AI technologies.
Over the last year, AI has become a popular topic. Some is hype, some is substance. Some is good, some is bad. We want to give you the good, not the bad, and ignore the hype! AI has a ton of opportunity – but also risk. So we put you in control – off by […]
Our new Nextcloud Podcast host, Brent Gervais, had the opportunity to sit down with Max Schrems – privacy lawyer and pioneer in the European data privacy movement – to explore some thoughts and ideas that stemmed from Max’s keynote given at the Nextcloud Conference 2023. We explore the newly adopted Transatlantic Data Privacy Framework, it’s […]