{"id":48362,"date":"2021-12-15T15:12:00","date_gmt":"2021-12-15T14:12:00","guid":{"rendered":"https:\/\/magazinnew.reichelt.de\/magazin\/?p=48362"},"modified":"2023-04-19T10:58:38","modified_gmt":"2023-04-19T08:58:38","slug":"get-started-with-ai-with-the-nvidia-jetson-nano","status":"publish","type":"post","link":"https:\/\/www.reichelt.com\/magazin\/en\/projects\/get-started-with-ai-with-the-nvidia-jetson-nano\/","title":{"rendered":"Get started with AI with the NVIDIA Jetson Nano"},"content":{"rendered":"\n

Artificial intelligence (AI) is the buzzword of our time. As the central driver of digitization, it is fundamentally changing society, the economy and almost all other areas of life. Many companies are already using AI: in development, in production, in administration. But artificial intelligence also helps us in everyday life – in some areas quite obvious, in others rather hidden. Learn more about AI and how you can use NVIDIA’s Jetson Nano to implement an AI project in this article.<\/p>\n\n\n\n

Artificial intelligence<\/h2>\n\n\n\n

What is artificial intelligence?<\/strong><\/h3>\n\n\n\n

Artificial intelligence is the ability of a computer to solve tasks that would normally have to be done by human hands. The system should be able to act intelligently, similar to a human, and learn independently. However, this definition is imprecise, as the term \u201cintelligence\u201d is difficult to define. There are a number of different descriptions of human intelligence. Gardner developed a theory of multiple intelligences that lists eight dimensions of intelligence:<\/p>\n\n\n\n

\"Multiple<\/a>
Figure 1: Source: <\/figcaption><\/figure>\n\n\n\n

As you will see as this article progresses, AI applies to many, but not all, of these dimensions today.<\/p>\n\n\n\n

What makes a computer intelligent?<\/strong><\/h4>\n\n\n\n

A classic algorithm is usually permanently implemented and makes decisions based on sensor data, user inputs and trigger moments. All actions of a computer have to be programmed by a human. Nowadays, however, the requirements for a computer are so complex that this method quickly reaches its limits. For example, it is impossible to accurately predict the behavior of a user or to implement all existing objects on earth for real-time object recognition in advance. <\/p>\n\n\n\n

The computer scientists recognized this problem very early on. Therefore they tried to develop adaptive computer programs. A computer can be trained in the desired functionality using sample data. This procedure can now be used to diagnose diseases based on symptoms or x-rays. <\/p>\n\n\n\n

There are various test procedures to assess whether a computer system is intelligent – one of them is the \u201cTuring test\u201d. A person communicates electronically with two partners: a human and a computer. The referee asks both of them a comprehensive catalog of questions. If he cannot clearly identify the PC based on the answers given, he is considered intelligent. <\/p>\n\n\n\n

Measured against the previously presented dimensions of intelligence, however, this test must be expanded so that other dimensions than pure knowledge (image, movement, language) can also be recorded.<\/p>\n\n\n\n

Machine learning<\/strong><\/h3>\n\n\n\n

How does the computer learn?<\/strong><\/h4>\n\n\n\n
\"\"<\/a>
Figure 2: Source: https:\/\/datasolut.com\/machine-learning-vs-deep-learning\/<\/figcaption><\/figure>\n\n\n\n

Nach menschlicher Definition gilt der Mensch als intelligentes Wesen. Wir l\u00f6sen eine Vielzahl von realen Problemen, ohne angeben zu k\u00f6nnen, wie wir es im Einzelnen machen. Ein Beispiel ist die Unterscheidung zwischen Apfel und Birne. \u00c4hnliches gilt f\u00fcr komplexe Bewegungsabl\u00e4ufe wie etwa das Radfahren: Kaum jemand kann im Einzelnen beschreiben, mit welchen Bewegungen er es schafft, das Gleichgewicht auf einem Fahrrad zu halten.<\/p>\n\n\n\n

Dies sind Beispiele von implizitem Wissen, welche wir nicht in Regeln oder Anweisungen fassen k\u00f6nnen. Wenn man keine expliziten Vorschriften hat, mit denen man einen Computer f\u00fcr eine Aufgabe programmieren kann, so ist das Lernen aus Erfahrungen oder Daten eine Alternative. Bei \u201emaschinellem Lernen\u201c analysiert ein System die verf\u00fcgbaren Daten und modifiziert sich schrittweise, sodass es seine Aufgabe besser erf\u00fcllen kann. Dabei werden drei Arten von Lernaufgaben unterschieden:<\/p>\n\n\n\n

Supervised learning<\/strong><\/h4>\n\n\n\n

In the case of supervised learning, the system is given what it should learn, such as how to differentiate between bicycles and motorcycles. To this end, he is presented with many pictures of bicycles and motorcycles that have already been manually marked as bicycles or motorcycles. After processing a large number of such examples, the system looks for patterns that can be used to distinguish the objects. In this way, the system can learn to apply these patterns to new images in order to distinguish bicycle images from motorcycle images. <\/p>\n\n\n\n

In the case of supervised learning, a distinction is made between two other important use cases: In the case of classification, the system has to choose the answer from a mostly small number of alternatives or classes. One example is the categorization of a product as \u201cgood\u201d or \u201cdefective\u201d. In the other application, the prognosis (regression), the system has to predict one or more continuous variables, e.g. the maximum temperature and wind strength for the next day in Munich. <\/p>\n\n\n\n

Unsupervised learning<\/strong><\/h4>\n\n\n\n

In the case of unsupervised learning, the system has to manage without manual specifications. It reads the available data and independently tries to find patterns and regularities in it. It can, for. B. Group data based on similarities. This approach is particularly promising when the data has different components – such as the different words in a written sentence. In the best case scenario, the values \u200b\u200bof one word can be used to predict the next component. <\/p>\n\n\n\n

This type of learning is also called self-supervised learning. It is a form of supervised learning that does not require people to provide annotations. Self-supervised learning is widespread in the world of artificial intelligence. For example, if a system is given the task of forecasting the next images in a video, it must develop a representation of the scenes and predict the possible movements and actions of the objects. If there are enough training videos, a basic \u201cunderstanding\u201d of the processes in videos is created. The system can use this as a basis for forecasting new video scenes. <\/p>\n\n\n\n

Reinforcement learning<\/strong><\/h4>\n\n\n\n

In reinforcement learning, also known as reinforcement learning, the system must first perform a series of actions before it gets to know the final result. Examples of this would be board games or controlling robots. After each action, the environment reacts (e.g. the opponent in chess) and the system receives new information about the status (e.g. the board positions), possibly also rewards (e.g. points, victory or defeat quantified by a Numerical value). <\/p>\n\n\n\n

The aim of the system is to develop an action strategy with which it can react to any situation in such a way that the highest possible amount of rewards is generated. The technique of reinforcement learning with the help of rewards and punishments is borrowed from psychology and is used, among other things, in the training of dogs.<\/p>\n\n\n\n

Deep learning<\/strong><\/h3>\n\n\n\n

Technically speaking, deep learning is a subset of machine learning (see Figure 4). It encompasses all methods of searching for patterns and relationships in data using a deep neural network. Artificial neural networks are algorithms that are modeled on the biological model of the human brain. <\/p>\n\n\n\n

The structure of an artificial neural network consists of the input layer, the hidden layer and the output layer. Despite their possible complexity, they essentially always have the structures of directed graphs. If an artificial neural network has particularly deep structures, i.e. many different hidden layers, it is called deep learning.<\/p>\n\n\n\n

\"\"<\/a>
Figure 3: Source: https:\/\/datasolut.com\/was-ist-deep-learning\/<\/figcaption><\/figure>\n\n\n\n

Such a system can, for example, predict the amount of precipitation tomorrow based on today’s readings of air pressure, temperature and wind direction. Although machine learning and deep learning are often used synonymously, there are small but subtle differences. While machine learning is used for structured input data, deep learning is particularly suitable for large unstructured data. <\/p>\n\n\n\n

Structured input data can be ordered data records from a database (example: cat with color, shape, face). Machine learning automatically recognizes the information from this and independently develops algorithms to classify these objects. In the case of unstructured input data such as texts, images or music, the deep learning algorithm recognizes unknown structures and uses this to develop a complex model that enables objects to be classified during image recognition. In order to be able to achieve a high model quality, however, this method requires very large amounts of data.<\/p>\n\n\n\n

\"\"<\/a>
Figure 4: Source: https:\/\/datasolut.com\/was-ist-deep-learning\/<\/figcaption><\/figure>\n\n\n\n

NVIDIA Jetson Nano Kits<\/h2>\n\n\n\n<\/span>The Jetson Nano development board from NVIDIA provides an introduction to the topic of \u201cAI\u201d. This makes it possible to develop cost-effective and energy-efficient AI systems. The single-board computer with four ARM cores and Maxwell GPU as a CUDA computing accelerator and video engine opens up new possibilities for graphics and computation-intensive projects. <\/p>\n\n\n\n

NVIDIA offers two versions of the Jetson Nano, the only differences being the size of the working memory (2\/4 GB RAM), the display port and the power connection. With a size of around 70 x 45 mm, the Jetson Nano-Module is the smallest Jetson device. This production-ready System-on-Module (SOM) offers great advantages for various industries when providing AI: It provides 472 GFLOPs so that modern AI algorithms can be executed quickly. Several neural networks can be run in parallel and numerous high-resolution sensors can be processed at the same time. With these properties, it is ideal for applications such as entry-level network video recorders, household robots, and intelligent gateways with full analytical capabilities.<\/p>\n\n\n\n

CPU<\/td>Quad-core ARM Cortex-A57 Moure processor<\/td><\/tr>
GPU<\/td>NVIDIA Maxwell architecture with 128 NVIDIA CUDA\u00ae cores<\/td><\/tr>
Main memory<\/td>2\/4 GB 64-bit LPDDR4, 1600MHz 25.6 GB \/ s<\/td><\/tr>
Memory<\/td>microSD (card not included)<\/td><\/tr>
Video encoding<\/td>4Kp30 | 4x 1080p30 | 9x 720p30 (H.264 \/ H.265)<\/td><\/tr>
Video decoding<\/td>4Kp60 | 2x 4Kp30 | 8x 1080p30 | 18x 720p30 (H.264 \/ H.265)<\/td><\/tr>
Network<\/td>Gigabit Ethernet<\/td><\/tr>
Camera<\/td>1x MIPI CSI-2 connector<\/td><\/tr>
Display<\/td>HDMI 2.0<\/td><\/tr>
USB<\/td>1x USB 3.0 Type A, 2x USB 2.0 Type A, USB 2.0 Micro-B<\/td><\/tr>
Connections<\/td>1x SDIO | 2x SPI | 4x I2C | 2x I2S | GPIOs<\/td><\/tr>
Size<\/td>69.6mm x 45mm<\/td><\/tr>
Mechanics<\/td>260-pin edge connector<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

What is a CUDA core? <\/strong><\/h4>\n\n\n\n

The term CUDA stands for \u201cCompute Unified Device Architecture\u201d and is an architecture developed by NVIDIA for parallel calculations. The additional use of the GPU relieves the CPU and increases the computing power of a computer. Since both cores are found on microprocessors based on semiconductor technology, CUDA cores are usually considered to be equivalent to CPU cores. In addition, both cores can process data, whereby the CPU is used for serial data processing, while the GPU is used for parallel data processing. However, CUDA cores are less complex. In addition, 128 CUDA cores are built into the GPU of the Jetson Nano, whereas the CPU only contains four cores. Apart from that, CUDA is used variably: in image and video processing, but also in the medical field, such as for CT image reconstructions. Due to the demanding development environment, CUDA is also often used in the areas of AI, deep learning and machine learning. Other areas of application are computer biology and chemistry, ray tracing and seismic analyzes.<\/p>\n\n\n\n

What is possible with the Jetson Nano? <\/strong><\/h4>\n\n\n\n

Due to its compact design, the Jetson Nano can be perfectly integrated into robot projects. With 128 CUDA cores, the single-board computer can carry out many operations in parallel and thus enables the use of several sensors with real-time calculation. Conversely, this means that it would be possible to develop an autonomously driving car with a Jetson Nano. Finally, thanks to the support of CUDA, a neural network could be trained directly on the Jetson Nano. In contrast, such a project with a Raspberry Pi could only be implemented with an additional GPU.<\/p>\n\n\n\n

Classic AI systems, such as object \/ person recognition in real time, are also possible with the Jetson Nano. With the help of the open source libraries OpenCV or YOLO, you can download pre-trained models in order to then carry out object \/ person recognition. It is also possible to train your own model. With enough data records, for example, people or car license plates can be clearly identified on surveillance cameras in order to automate door opening, for example.<\/p>\n\n\n\n

Real-time object recognition with the Jetson Nano<\/strong><\/h3>\n\n\n\n

With the help of a simple project, we would like to show you the strength of the Jetson Nano, as mentioned above. Object recognition as a typical AI requirement for systems can basically also be mastered by single-board computers without a CUDA core, such as the Raspberry Pi. In order to be able to solve this requirement in real time, however, CUDA cores are indispensable, since large amounts of data have to be calculated in parallel and in real time. With its 128 CUDA cores, the Jetson Nano is ideally suited for this and was therefore selected for this project.<\/p>\n\n\n\n

Effort <\/strong><\/h4>\n\n\n\n

Since the AI \u200b\u200bfor real-time object recognition has already been preprogrammed within the open source environment of OpenCV and YOLO, the effort of this how-to is limited. As long as no new objects are to be taught to the AI, you do not have to train the neural network any further. However, if the AI \u200b\u200bis to be further adapted, some in-depth technical knowledge is required. The real effort, however, is to download and install the AI \u200b\u200bmodel and prepare the necessary setup (camera connection) for the application.<\/p>\n\n\n\n

Level of difficulty <\/strong><\/h4>\n\n\n\n

Medium: <\/strong>Without training the AI
Difficult: <\/strong>With training in AI (knowledge of OpenCV \/ YOLO and programming knowledge in Python and C)<\/p>\n\n\n\n

Expenditure of time <\/strong><\/h4>\n\n\n\n