NLP English resource missing

  • 3 Replies
  • 3002 Views
*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1729
    • mind-child
NLP English resource missing
« on: February 24, 2016, 12:31:26 pm »
Does anyone know of a good natural language resource from which I can extract English grammar? I think I had an AGFL link, but their site is not online anymore. Thanks in advance.

*

Don Patrick

  • Trusty Member
  • ********
  • Replicant
  • *
  • 633
    • AI / robot merchandise
Re: NLP English resource missing
« Reply #1 on: February 24, 2016, 04:24:00 pm »
I have no experience with it, but the industry standard and most recommended is Stanford's: http://nlp.stanford.edu/software/
CO2 retains heat. More CO2 in the air = hotter climate.

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1729
    • mind-child
Re: NLP English resource missing
« Reply #2 on: February 24, 2016, 06:36:59 pm »
Tx, but Stanford's won't do. :-\

I need some English grammar definition files for my Javascript project that would parse natural language and do some overlay logic inference in the same pass, by the same algorithm.

After hours of searching, the best thing I've found is free "treebank" files. Those files provide thousands of sentences whose words and sentence parts are annotated by: "noun", "verb", "adjective", "propositional phrase" and similar gradually granulated stuff, like in the following code:

Code
(S (NP (NNP John))
   (VP (VBZ loves)
       (NP (NNP Mary)))
   (. .))

From those files I can automatically construct the grammar for English language. The good news is that treebanks are popular on the web, maintained by influent organisations like universities, and they exist for a lot of different languages. I was hoping for some BNF-like rules, but I'll probably use treebanks if nothing else doesn't pop out. Maybe even to provide an arbitrary-treebank-use as a seed for generating grammar rules. Users might like it.

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1372
  • Humans will disappoint you.
    • Home Page
Re: NLP English resource missing
« Reply #3 on: February 24, 2016, 07:26:08 pm »
Here are two of the most advanced open source English parsers that are currently available.

http://ilexir.co.uk/applications/rasp/

http://www.nactem.ac.uk/tsujii/enju/

I've also written an extensive C library that parses English according to the rules laid out in "The Cambridge Grammar of the English Language" which is the most modern and complete descriptive grammar yet published. However it's still a work in progress and I'm not ready to release it yet. Here's an example of the output of my program:

<Clause>
   <Subject Clause_type='declarative' Number='plural' Person='third' Verb_type='complex_intransitive'>
      <Nominal Number='plural'>
         <Noun_BOX Case='plain_case' Category='common_noun' Number='plural' Number_type='count'>Boxes</Noun_BOX>
      </Nominal>
   </Subject>
   <Predicator Clause_type='declarative' Number='plural' Person='third' Verb_type='complex_intransitive'>
      <Verb_REST Number='plural' Person='third' Verb_form='present' Verb_type='complex_intransitive'>rest</Verb_REST>
   </Predicator>
   <Subjective>
      <Preposition_ON Category='preposition' Selects='Preposition_ON' grammaticised='yes' particle='yes'>on</Preposition_ON>
      <Determiner>
         <Determinative>
            <Determinative_THE Category='definite'>the</Determinative_THE>
         </Determinative>
      </Determiner>
      <Nominal Number='singular'>
         <Noun_TABLE Case='plain_case' Category='common_noun' Number='singular' Number_type='count'>table</Noun_TABLE>
      </Nominal>
   </Subjective>
</Clause>


 


Requirements for functional equivalence to conscious processing?
by DaltonG (General AI Discussion)
November 19, 2024, 11:56:05 am
Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

246 Guests, 0 Users

Most Online Today: 491. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles