Natural Language Processing library

  • 6 Replies
  • 2947 Views
*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1372
  • Humans will disappoint you.
    • Home Page
Natural Language Processing library
« on: April 28, 2018, 10:31:55 pm »
Found this relatively new natural language processing library this morning. It's only a statistical parser so it might not provide much new functionality, but it is written in C with Python bindings and it claims to be fast. The examples given show a nice clean API. Has anyone tried it out yet?

https://spacy.io/

*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 325
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Natural Language Processing library
« Reply #1 on: April 29, 2018, 12:34:21 am »
Em .....


I've seen it!.....
Most of their functions i have already created .... But their neural network looks interesting... Although I'm not ready to use neural networks in my AI yet.

I was able to reduce my database by Creating a data-warehouse then extracting the data-marts required. obviously there were lots of Crossover information as well as duplicate data. Things like the opencyc data has no actual use as it is full of bad information.
but when I created my parts of speech tagging the main dictionary was created. Over time i adjusted my Tagging system adding Various categories and lists such as "cars" so when a car is detected the tagger tags it as PNNC (PronounCARS) or Colors as PNNCL. this enables for Categorical entity recognition. as these needs increase or lists are created I often delete tags and Re-Enter under a New-Tag... Requirements / needs of NLP are constantly changing.  I do not use the REPLACEMENT TECHNIQUE .... so my database actually only contains "facts".

If i was to tell the AI Arts owns a CAR... It would store the information in a new "person" location alongside its Predicate (Owns),  Person (owns) OBJECT.... When Enquiring about Art owning a Car it would check His person object for the properties known about that person.... if known...(BASIC).

the route that i have chosen is not to collect all information or attempt to program every answer.... I rely on NLP and Grammar to do All the Work.... (i only have the Topic/Response Keyword/Detect Topic... QA ... Paradigm remaining from the past (obviously and old QADB TOO) as it works well for Loose learning as well as targeted data capture.

The NLP librarys out there are mainly for statistical modelling as its the current trend..... The R programming language has created the "BUZZ" although everybody prefers to Use the python for these tasks. Well done to Tensorflow and such interfaces (commercial)
The Spacy is actually a simple product to use.... Although (Limited by their Small Database) !

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1372
  • Humans will disappoint you.
    • Home Page
Re: Natural Language Processing library
« Reply #2 on: April 29, 2018, 12:42:12 am »
Um thanks I think.

*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 325
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Natural Language Processing library
« Reply #3 on: April 29, 2018, 01:29:17 am »
Found this relatively new natural language processing library this morning. It's only a statistical parser so it might not provide much new functionality, but it is written in C with Python bindings and it claims to be fast. The examples given show a nice clean API. Has anyone tried it out yet?

https://spacy.io/

Really im saying that The API is Good but these librarys are not coming up with anything NEW just repackaging.... I suppose the best API will win!

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1372
  • Humans will disappoint you.
    • Home Page
Re: Natural Language Processing library
« Reply #4 on: April 29, 2018, 01:42:04 am »
Really im saying that The API is Good but these librarys are not coming up with anything NEW just repackaging.... I suppose the best API will win!

Thanks, that's actually what I thought you were saying and I agree with that too. I was just distracted by the free-form nature of your reply. ;)

The only advantage this one claims to have is speed and interchangeable models. There is a third party advertising (link spamming) models for it on chatbots.org today which is how I found out about it. Though less relevant, it also claims to be based on a neural network architecture.

In terms of what it can do, it is inferior to my own parsing libraries in all areas so I'm not considering using it myself. I thought others might be though.

*

Don Patrick

  • Trusty Member
  • ********
  • Replicant
  • *
  • 633
    • AI / robot merchandise
Re: Natural Language Processing library
« Reply #5 on: April 29, 2018, 08:04:52 am »
I haven't tried it but I've come across a lot of NLP people recommending it as much as Stanford's parser, so I reckon it's as solid as statistical parsers will get.
CO2 retains heat. More CO2 in the air = hotter climate.

*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 325
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Natural Language Processing library
« Reply #6 on: May 06, 2018, 11:49:07 am »
I haven't tried it but I've come across a lot of NLP people recommending it as much as Stanford's parser, so I reckon it's as solid as statistical parsers will get.

Its a Starting point! its quite old now.

But really to build your own... you just need your dictionary / and Context free grammar to find the unknowns..... (or implement a hidden Markov sequencing prediction).... then you may find it works better! (Controlled is always better) as any errors you can deal with them... There is also a Porter Stemmer which is out there.... Also a Good starting point.

 


Requirements for functional equivalence to conscious processing?
by DaltonG (General AI Discussion)
November 19, 2024, 11:56:05 am
Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

493 Guests, 0 Users

Most Online Today: 532. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles