WINDELIN success story case.
Predictive Maintenance and Optimisation of Wind Turbines using an open-source Big Data Machine Learning Cloud Wind energy is a fast growing global market in demand of innovative solutions that can optimise operations while reducing production costs. Machine learning and big data have increased competitiveness in many industries by gathering data and using A.I. to predict…
Windelin presentation at Nexedi 4.0 Meetup in Stuttgart, Germany
Windelin presentation at Nexedi 4.0 Meetup in Stuttgart, Germany by Ivan Tyagov, Nexedi.
NEO powered ERP5 reaches 100 TB of Wendelin out-of-core data
NEO, the distributed transactional NoSQL object database of Nexedi, has reached on November 24th 2017 a storage size of 100 TB on a redundant array of inexpensive computers. This success demonstrates that both ERP5 open source ERP/CRM and Wendelin out-of-core Big Data platform can power the biggest commercial bulkloads, both for transactional and data science applications. The data stored in NEO consists of 30 big data…
Wendelin: core version 0.5 upgrade and performance tests
Project Wendelin The Wendelin project started in the beginning of 2015 with Nexedi as consortium leader in charge of managing the development of a big data solution “made in France”. Wendelin is based on open source software components and combines a number of widely used libraries for data analysis, modification and visualization. The project also…
High Peformance Multi-core Python at Nexedi
Due to global interpreter lock (GIL), python threads do not provide efficient multi-core execution, unlike other languages such as golang. Asynchronous programming in python is focusing on single core execution. Happily, Nexedi python code base already supports high performance multi-core execution either through multiprocessing with distributed shared memory or by relying on components (NumPy, MariaDB) that already support multiple core execution. The…
Technology Showcase: Leveraging MariaDB in NEOs Distributed Storage Architecture
This blog post is part of a series introducing 3rd-party open-source technologies used within the free software solutions created by Nexedi. One of these solutions is NEO, our distributed, redundant and transactional ZODB storage designed as alternative to ZEO and FileStorage. With flexibility and reliability in mind, Nexedi chose MariaDB as a core component of…
Optimising MariaDB for Big Data
Nexedi has developed for about ten years a distributed transactional replicated object store powered by MariaDB: NEO. We use NEO to store all kinds of data: records for ERP5 or large arrays of floating points for Wendelin big data platform. NEO, ERP5 and Wendelin are implemented entirely in python. NEO’s architecture NEO is an implementation…