Typical artificial intelligence algorithms and real-world applications related to Handwritten number classifier

. Artificial Intelligence is a science that aiming to creating systems to imitate human wisdom, and perform tasks such as learning, reasoning, problem-solving, perception, natural language understanding, and some forms of creativity. This paper is about handwritten number classifier, a specific field within artificial intelligence, and its use across various industries. The basic concepts about artificial intelligence will be given at the first and the definition and structure of three representative artificial intelligence algorithms, convolutional neural networks, recurrent neural networks, and long short-term memory neural networks will be exemplified to better illustrate the concepts. Furthermore, the applications of handwritten number classifier will be analysed, especially in the areas of large-scale data statistics or survey, finance and taxation, and mail sorting. Eventually, a conclusion encompassing the challenges that the artificial intelligence systems are faced and reasoning regarding the significant role that artificial intelligence plays in the urban areas of the world is given for further discussion.


Introduction
There is no doubt that artificial intelligence has gained immense popularity in urban areas worldwide, owing to its capacity to emulate human cognitive abilities within machines.Its exceptional performance across a range of tasks, encompassing learning, reasoning, problem-solving, perception, natural language comprehension, and even certain forms of creativity, positions it as a pivotal player across

Basic concepts
To illustrate the basic concepts, this paper will discuss three widely used neural network algorithms in the area of hand written number classifier, that are the convolutional neural networks, recurrent neural networks, and long short-term memory networks [4][5][6][7][8].Their definition and architecture will be given and analyzed.

Convolutional neural network
To start with, the convolutional neural networks is inspired by the cortex of the animals especially by the mammals.It uses a key operation called convolution, which has the mathematical meaning of to combine two functions to generate a third function which represents the shape of how one function has effect on the other.Or in simple words, what people see now is the sum of the past.In convolutional neural network, this concept is used between the input data and a set of learnable filters, it works surprisingly well as the basic for detecting grid-like data such as images [5]. Figure 1 shows a typical layout of the convolutional neural networks.

Input layer.
The input layer is where the model receives its initial data input.The number of neurons in this layer matches the total number of features in the input data.For instance, in the case of handwritten number classifiers, it corresponds to the number of pixels in the input image.

Convolutional layers.
And the input data given to the input layer will then be fed to the convolutional layers, which is also the main workplace for the convolutional neural network algorithm.In these layers, multiple filters will be used to slide over the input image, and each of those filters will have the obligation of detecting different features such as edges, textures, and shapes.

Pooling layers.
Then the output from these filters and the convolutional layers will be feature maps, of which the spatial dimensions will be reduced while keeping the significant information by the pooling layers using operations like max pooling or average pooling.In most cases, max pooling will be applied and the maximum value within a region will be selected as the representative value for that area [6].
2.1.4.Fully connected layers.Following a series of operations conducted by various convolutional and pooling layers, the fully connected layers step in to process the features extracted by the prior layers.

Output layer.
The structure of the output layer may be customized depending on different tasks to produce a proper output of the network.Besides, in order to achieve the non-linearity which is crucial for handling complex patterns in data, activation functions will be used after each convolutional layer.

Recurrent neural network
Subsequently, an introduction to recurrent neural networks will be given.This class of neural networks accepts data from both current and previous inputs owing to its internal memory.Hence, this algorithm is used to handle tasks which involves sequential data or time-series data such as video streams and audio streams.In these two types of data, they all contains timestamp data to indicate the time when they are generated [7]. Figure 2 illustrates the layout of the recurrent neural networks.

Input layer.
In the input layer, the input function will take the input at each discrete time step at a time until it finishes all the data point in the time series.For example, if a clip of video is given to the model, the input function will take one frame of the video each time.

Hidden state.
The hidden state encompasses recurrent layer and hidden layer.The taken data point from the input layer will be sent to the hidden state, in this state, the output from the last iteration will be passed as the input of the current iteration to fulfil the memory function of the algorithm as this looping mechanism gives the network a sense of context.And this loop may happen as many times as required.

Output layer.
The output layer of the network will generate an output basing on the result of the hidden state at every time step of the input and the content of this layer may also vary with the requirement of the task.

Activation functions.
Just like convolutional neural networks, this class of neural network also involves activation functions with the hidden state to make sure the algorithm's non-linearity and capability of handling complex problem.

Flaws by design.
This algorithm has some inherent flaws.For example, it has to process the input sequence of data sequentially, which means that this algorithm is lacking parallelism and computationally expensive when dealing with long sequence of data as it has to process all the data points within the time series.Most importantly, the vanishing and exploding gradient issues associated with this algorithm is not resolved [7].This is due to the fact that once the gradients carrying information used in the network becomes small or large, this slope may propagate each time looping back and decay or grow exponentially through time.

Long short term memory
Eventually, long short term memory neural networks will be introduced.This is a special kind of recurrent neural networks aiming to resolve the limited capabilities of handling long sequences and the exploding and vanishing gradient issue [8]. Figure 3 displays the layout of the Long short-term memory.

The gating mechanism.
This solution is carried out by adding the gating mechanism which enables the algorithm to retain or discard information intentionally from the previous time steps to the algorithm.Long short-term memory neural networks have three different types of gates.

The gates.
In a nutshell, think of the input gate as the "decider" that helps figure out if it's a good idea to add some new information to memory.On the other hand, the forget gate acts like a virtual "cleaner," helping determine if it's time to clear out any outdated or unnecessary information from the memory bank.When it's time to make a decision, the output gate steps in as a trusty guide, pointing out which pieces of information from the memory are the most helpful in the moment [8].Thus, in a way, these gates work together like a team, making sure the memory is sharp and ready to assist in making smart decisions.

Application
Furthermore, the application of handwritten number classifier will be illustrated.In the referenced paper, it gives examples of the applications of handwritten number classification in different fields.

Large-scale data statistics or survey
It can be used in large-scale data statistics or survey.To be more specific, in this kind of statistics, a large amount of effort will be required if all the data are documented by manpower.However, with the help of handwritten number classifier, the neural network can be used to do the digitalization and preprocessing of the data so that the manpower can all be saved.For example, if the related data to population census is converted by the classifier into a digital form, all the later computations for those digitalized data will be easier since now people can use programming language which is capable of handling a large amount of data like R as an aid.While if the digitalization of information does not take place, manpower computations might be needed.

Finance and taxation
The handwritten number classifier can be used in the field of finance and taxation [9].To clarify, with the economic recovery after the COVID-19 pandemic, more and more financial and tax statements, checks, and invoices are waiting to be processed every day.In this case, handwritten number classifier can be applied to extract and interpret the numerical information from these financial bills, and put them into a digital form which is beneficial to later large-scale data analysis and computation.

Mail sorting
The handwritten number classifier can be used in mail sorting [10].In this case, the classifier can be applied to recognize postal codes and addresses.Then, the mails can be sorted depending on their destination to ensure they go to the correct location.Simultaneously, the human error that happens during the manual mail sorting can be reduced.Besides, the mailing companies will now have a better cost efficiency with the help of the classifiers as they will now only pay for the maintenance fee for the classifier, rather than the labour costs which can be high especially for companies with high mail volumes.

Conclusion
In summary, the emergence of artificial intelligence marks a significant milestone in human history.Its integration into our daily lives has ushered in profound transformations and opened up boundless potential for an AI-driven future.
However, while the handwritten number classifier proves to be a potent tool, it comes with its own set of challenges.Firstly, there exists a wide variability in handwriting styles.Individuals from different regions, countries, and cultures may exhibit vastly different approaches to writing.This includes cases of writing deformation and cursive script, making it difficult for the classifier to accurately delineate the boundaries of numbers.This poses a considerable challenge for engineers tasked with designing a classifier suitable for all writing styles.Secondly, numeric characters lack contextual information, leading to potential ambiguities and difficulties in distinguishing individual characters during the recognition process, especially for poorly written ones.For example, a poorly written "1" may bear a resemblance to a "7."Thirdly, handwritten digit recognition is predominantly utilized in fields such as finance, where stringent accuracy standards are upheld, with no room for errors.Moreover, in largescale digit processing, the speed of recognition becomes a crucial requirement.Striking the right balance between accuracy and efficiency in handwritten number classification stands as the primary research hurdle.
Looking ahead, in a future characterized by the harmonious coexistence of artificial intelligence and humanity, we are presented with unparalleled opportunities to forge new frontiers and cultivate a brighter world.