Demystifying NLP Part 1
Since this is my first official blog, I’d like to introduce myself before diving into the details…
Hi folks, I’m Nida Aibani. I’m currently working as a Sr. Manager, Data Scientist at a Financial, Banking Firm. Before this, for 3 years I worked as an ML Engineer at Reliance Jio where I developed skills in various applications in Machine Learning, Natural Language Processing, and Speech Recognition. It is a pleasure sharing the knowledge that I have received, Thank you for your time.
So a little something more about myself. Of course, being a tech geek my hobbies include… Participating in ML hackathons and developer meetups. Well, I also like to unwind by enjoying my favorite sport scuba diving every once in a while. Well, it’s now time to dive into today’s session. (Yah!! I finally got Certified!!)
So now let’s dive into Machine Learning and its Applications.
Module 1:
NLP What? How? Why?
We as humans can interpret what is spoken to us very easily. This is not as easy a task for Machines. Making sense of tasks or action items or just general comments too is a challenging task for them!! Let alone understand grammar and annotations of languages! This is NLP!
So how do tackle this complex task?
Information Extraction
IE is key for machines to interpret NLP. Machines need to break the language into various components such as Intents: that is action items, Entities: parts of the sentence that have important information about the task,
Tokenization: Breaking up the entire sentence into words or tokens,
Example:
Send SMS to Neha saying get flowers
Intent: Send SMS
Entities: Neha — Receiver; Message Content: get flowers
After information extraction normalizing the text is the next step:
Tokenization
The entire sentence is broken down into words or tokens. These tokens are used as features for NLP models
Stemming/Lemmatisation
Stemming or lemmatization is used for normalizing the tokens into root words. We will discuss techniques and NLP Applications in detail in the next post.
Now you are all set to get to start building your applications with NLP
Best of Luck
If any queries do not hesitate to reach out to me https://www.linkedin.com/in/nida-aibani-210996
