Catalogue of Services

Performance evaluation of AI and robotics based on physical testing environments

Laboratoire National de Métrologie et d’Essais - LNE

Location

France

Arable farming

Food processing

Greenhouse

Horticulture

Livestock farming

Tree Crops

Viticulture

By having your AI or robotic system tested by LNE, you ensure it meets the highest standards of safety and performance, boosting your product’s reliability and trustworthiness in the market. Partnering with LNE for rigorous testing of your robotic and AI technologies gives you a competitive edge, as our testing report enhances credibility and opens doors to new market opportunities both locally and globally. Testing of devices with AI-integrated control systems by our LE.IA facility focuses on both performance and performance-related safety. Our tests, conducted under controlled laboratory conditions, ensure optimal reproducibility and repeatability, providing reliable insights into the system's efficiency and safety-critical functionalities.

Performance evaluation of an AI model

Josephinum Research

Location

Austria

Remote

Arable farming

Horticulture

Livestock farming

Tree Crops

Viticulture

Our service provides a thorough evaluation of AI models by utilising a wide range of benchmark datasets—from images and sensor data to remote sensing and multimodal data. This comprehensive testing assesses the model's performance across standard metrics, specifically chosen based on the model’s intended tasks. The results offer insights into the model’s effectiveness and accuracy, guiding developers in refining their AI solutions to achieve optimal performance in real-world applications.

Performance testing of deep learning solutions

University of Cordoba

Location

Remote

Spain

Arable farming

Food processing

Greenhouse

Horticulture

Livestock farming

Tree Crops

Viticulture

This service evaluates the performance of deep learning algorithms to determine their efficiency and feasibility for migration to embedded devices. By leveraging high-performance computing (HPC) and GPU resources, this testing helps developers understand how well their algorithms perform in terms of speed, accuracy, and resource consumption. The service is particularly beneficial for applications in food processing, such as beekeeping and pollen counting, where real-time data processing is essential.

Performance Testing of Robotic Systems and AI Solutions

Lukasiewicz - Poznanski Instytut Technologiczny

Location

At user's premises

Poland

Arable farming

Food processing

Greenhouse

Horticulture

Livestock farming

Tree Crops

Viticulture

We provide physical testing services, under both laboratory and field conditions, to assess the proper performance of the object under test, the level of quality, and the performance achieved. These tests focus on evaluating the performance of an object under laboratory and operational (field) conditions while maintaining its proper functionality. Our testing process helps identify potential weaknesses in the design of the device, offering insights that can inform adjustments to algorithms or hardware. This service aims to ensure that systems perform reliably under a variety of conditions, helping to prevent failures and maintain optimal performance in real-world applications.

Physical Testing of Endurance & Reliability

Lukasiewicz - Poznanski Instytut Technologiczny

Location

At user's premises

Poland

Arable farming

Food processing

Greenhouse

Horticulture

Livestock farming

Tree Crops

Viticulture

We provide physical testing services, both in laboratory and field environments, to evaluate the endurance and reliability of devices and their components. These tests focus on the ability of components to withstand external conditions while maintaining proper functionality. Our testing process helps identify potential weaknesses in device design, offering insights that can inform adjustments to algorithms or hardware. The service is designed to ensure your systems can perform reliably under a variety of conditions, helping to prevent failures and maintain optimal performance in real-world applications.

Preparation of computational test environment

Politecnico di Milano

Location

Italy

Remote

Arable farming

Food processing

Greenhouse

Horticulture

Livestock farming

Tree Crops

Viticulture

To successfully conduct a digital testing campaign, preparatory activities are usually required to set up the computational environment used for testing. This service performs activities such as: - setting up the hardware resources needed to run the tests - configuring and initialising the virtual environments used for testing (e.g., Docker images, private “data rooms” for safe data sharing) - installation and configuration of required software packages and dependencies - Setting up authentication layers, user roles and credentials as needed- Migration and/or exchange of required data and ground truth annotations - installation and configuration of a simulator - importing and configuring a previously defined simulated environment - executing dry runs to check that all elements of the test environment operate as required Environment preparation is done according to an environment design provided by the customer. If needed, such design can be done by AgrifoodTEF for the customer via Service S00176. Interested customers can get support from AgrifoodTEF for the entire pipeline involved in digital testing, from the design of its other elements beside the environment (namely, the testing protocol via service S00177 and the evaluation metrics via service S00178) to test execution (service S00182) and data collection (service S00183) and evaluation (S00184). Support in interconnecting the systems under test to the digital testing environment, if needed, is available via service S00181.

Providing demonstration testing on the test field of robotic or AI-driven solutions

Lukasiewicz - Poznanski Instytut Technologiczny

Location

Poland

Arable farming

Food processing

Greenhouse

Horticulture

Livestock farming

Tree Crops

Viticulture

As part of the service, a testbed will be provided for product demonstration of robotic machines along with AI systems. The polygon will be configured and prepared to meet the customer's individual needs in terms of field operations, technological processes, and communication. The service provider will provide polygons with a variety of surfaces according to the customer's specifications, e.g., meadow, ploughed field. The service will include soil moisture control, continuous monitoring of the field, and all activities carried out on it. The service providers will provide the necessary assistance and infrastructure needed to support the fieldwork carried out by the surveyed sites. The service may also involve demonstration of AI systems used in apiaries.

Provision of dataset for agricultural applications

Laboratoire National de Métrologie et d’Essais - LNE

Location

Remote

Arable farming

Food processing

Greenhouse

Horticulture

Livestock farming

Tree Crops

Viticulture

Our service offers a comprehensive collection of high-quality datasets tailored for agricultural applications, specifically designed to facilitate the testing and training of AI systems. These datasets encompass a wide range of data types, such as RGB or infrared images, 3D scans of LiDAR, or tabular data, ensuring that users have access to the relevant information needed for effective model development. By providing clean, well-structured, and annotated data, we empower agricultural businesses, researchers, and developers to enhance their AI solutions, driving innovation and efficiency in the industry. With our datasets, users can accelerate their projects, improve decision-making, and ultimately contribute to more sustainable agricultural practices.

Provision of datasets

Politecnico di Milano

Location

Italy

Remote

Arable farming

Food processing

Greenhouse

Horticulture

Livestock farming

Tree Crops

Viticulture

During the development of systems based on AI and/or robotics, tailored data are needed to support the realisation, validation and optimisation of systems and subsystems. This service aims at providing such data. AI models are a noteworthy example of systems that require data to be trained; more generally, any system which processes data produced via artificial perception (such as images, videos, LiDAR, ultrasound, radar...) requires suitable data to be built, tested and fine-tuned. This service allows a customer to define together with AgrifoodTEF the specific features of the data that the customer’s activities require and to receive datasets precisely matching such features. Among the features to be defined are the type, number and specifications of the data streams comprised in the datasets (e.g., when multi-sensor data are required) and the range of variations encompassed by the data (e.g., variety of environmental conditions represented in a sensor stream); lower-level features to be defined concern formatting and packaging of the data.

Provision of datasets

Fondazione Bruno Kessler

Location

Remote

Arable farming

Horticulture

Tree Crops

Viticulture

FBK is developing its own datasets based on its experience in the robotics and agricultural sector. These datasets can be used for training and testing of the solution proposed by the customer. Different kinds of datasets can be provided (raw, unprocessed, or processed data) according to the customer's specific needs. This service is often an essential first step for the validation process of a new product.

Provision of datasets

Josephinum Research

Location

Remote

Arable farming

Horticulture

Tree Crops

Viticulture

Our service offers a comprehensive dataset tailored for training or testing your solutions in the technology and agricultural sectors. Whether you're looking to enhance existing models or build new ones, our versatile data can be adapted to fit your specific needs. For those requiring an even more robust solution, our service seamlessly integrates with our data augmentation and labelling service (S00172), ensuring that you have access to well-organized and precisely labelled data. This flexibility allows us to support a variety of sensors and use cases, utilizing both existing data records and capturing new data in your application area. Optimize your agricultural technology solutions with our data services, designed to propel your projects forward efficiently and effectively.

Provision of datasets for AI training in real vine-growing conditions

Institut Français de la Vigne et du Vin - IFV

Location

France

Viticulture

If you already have an AI-based project in the viticulture field but need more data to enhance your model, we can provide you with tailor-made datasets thanks to our experimental vineyard and its great diversity in terms of grape varieties, soil conditions, and moisture at different periods of the canopy growth. Datasets can concern vines, grapes, juices, and even wine.