Amazon dataset for multilingual NLU

  • 2 Replies
  • 2599 Views
*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1372
  • Humans will disappoint you.
    • Home Page
Amazon dataset for multilingual NLU
« on: April 22, 2022, 02:03:14 am »
https://www.amazon.science/blog/amazon-releases-51-language-dataset-for-language-understanding

Quote
Imagine that all people around the world could use voice AI systems such as Alexa in their native tongues. One promising approach to realizing this vision is massively multilingual natural-language understanding (MMNLU), a paradigm in which a single machine learning model can parse and understand inputs from many typologically diverse languages. By learning a shared data representation that spans languages, the model can transfer knowledge from languages with abundant training data to those in which training data is scarce.

A long time ago I decided to focus my efforts on natural language understanding. It is only one aspect of intelligence but I figured that our natural languages have evolved to model what we think about. Therefore, if I could write software that could model what we think about, I would have solved a large part of the problem.

*

chattable

  • Electric Dreamer
  • ****
  • 127

*

MikeB

  • Autobot
  • ******
  • 224
Re: Amazon dataset for multilingual NLU
« Reply #2 on: April 25, 2022, 08:18:53 am »
NLU, NLP, speech recognition is all still undiscovered science. Since the Hidden Markov Model (statistical analysis) began in the 1980's, true scientific study stopped, and was replaced by giving the machine "enough information" to then guess from...

Still undiscovered:
  • What links words together in the most broad sense of synonyms, such that changing language mid sentence is possible and replacing blank words with "something"/"someone" (etc).
  • What links sentences together in the most broad sense to cover any language at once, with similar sentences, to output broad intentions.
  • Reverse looking-up the above in finding missing words/homophones in speech recognition/speech-to-text.
  • How can you track real sound waves in real time without guessing, with valid ranges, discovering accents, replacing accent-based vowel substitution with common types. Etc.

Throwing more power at an unsolved problem doesn't help smart watches/glasses/vr & ar devices.

 


Requirements for functional equivalence to conscious processing?
by DaltonG (General AI Discussion)
November 19, 2024, 11:56:05 am
Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

347 Guests, 0 Users

Most Online Today: 532. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles