Artificial intelligence (AI) is a field of computer science that emphasizes the creation of intelligent machines that work and react like humans.
Artificial intelligence studies dating back to the 1940s generally analyze the way of thinking of humans and aim to develop similar artificial instructions.
Robots that can think, learn and move more human-like with each passing day, aid us in our daily habits and can even prepare a tasty dish by imitating a talented chef.
How will they use this potential power in the future? As Stephen Hawking once thought, will AI be the end of mankind? Or is this theory merely a joke made by the humanoid robot Sofia?
Computer Vision
In supervised learning, machines learn from labelled examples. In Computer Vision, the machine is taught to identify everyday objects like chairs, table, and pillars in a room, or cars, pedestrians, and pavement on the road. The training data set needs the “ideal answer”, also known as “ground truth”, to be associated with each training sample, for the machine to build a feedback loop and improve its answers. Associating the ground truth with the data is called labelling, and relies on human specialists. This is called human judgement. This concept also applies to other types of data. For Natural Language Processing, machines need to be taught the difference between “That chicken burger was so bad” and “I want a chicken burger so bad”. Though both sentences share several words, they mean totally different things. Hence machines need to be trained on a large volume of meticulously labelled data. This is where humans step in to parent the machine-learning model.
Functioning
To a machine, an image is simply a series of pixels. But labelled images show machines that certain collection of pixels are certain semantic objects (like a lamppost or a truck). The images are labelled by data experts or “Humans in the Loop”. Labelling experts perform semantic segmentation on hundreds of street images every day. They label the elements in the images into predetermined classes of objects, ultimately dividing the image into semantically meaningful parts. Similarly, in NLP, humans in the loop perform named entity recognition, sentiment analysis, speech to text validation to help bolster the machine learning.
Without human judgment, such data is opaque and cannot be used to train machine-learning algorithms. Likewise, humans also audit the results of an algorithm, to ensure it isn’t going off-track. Human nuance combines with machine scale to create a machine learning solution. The reliance on humans is a lesser-known aspect of machine learning and can come as a surprise to new practitioners.
Data labelling is an increasingly specialised service. In the past, machine learning efforts relied on the data scientists or some interns, to perform the labelling. Today, companies must plan for scalable and secure data pipelines where they can ensure consistent and high-quality labels for millions of data points. Scientists must be able to iterate rapidly on training experiments and add or remove features which help them get better results. More and more nuanced categories of data need to be labelled. Diversity in the labelling workforce can also help create a more rounded input data set in very subjective scenarios.
To choose a successful Artificial Intelligence (AI) solution, pilot and implement machine learning within your company, you have to ask some key questions before you deploy a highly paid Machine Learning team. First, where is the data? Do you have proprietary data or are you going to use public datasets? Will your choice create enough accuracy and differentiation in the problem you set out to solve? Next, how will you pilot and scale your data labelling and auditing efforts? Do you have a reliable vendor who can grow with your needs? Today’s algorithms can deliver increasingly higher accuracy if trained on larger and larger data sets. Do you have the necessary budget set aside to handle data labelling at scale, including version management and tool integration? Do you require domain expertise or can you work with labellers who are trained using instructions from you? What’s the change management? Larger companies are now defining data pipeline managers whose role is to consolidate and streamline external data labelling efforts for various data teams within the organisation. This is a sign that the discipline is being addressed with the seriousness it requires to make your Artificial Intelligence (AI) practises to be more successful. Make friends with your training data. It will repay you in spades.
