NLP English resource missing

  • 3 Replies
  • 2851 Views
*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1723
    • mind-child
NLP English resource missing
« on: February 24, 2016, 12:31:26 pm »
Does anyone know of a good natural language resource from which I can extract English grammar? I think I had an AGFL link, but their site is not online anymore. Thanks in advance.

*

Don Patrick

  • Trusty Member
  • ********
  • Replicant
  • *
  • 633
    • AI / robot merchandise
Re: NLP English resource missing
« Reply #1 on: February 24, 2016, 04:24:00 pm »
I have no experience with it, but the industry standard and most recommended is Stanford's: http://nlp.stanford.edu/software/
CO2 retains heat. More CO2 in the air = hotter climate.

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1723
    • mind-child
Re: NLP English resource missing
« Reply #2 on: February 24, 2016, 06:36:59 pm »
Tx, but Stanford's won't do. :-\

I need some English grammar definition files for my Javascript project that would parse natural language and do some overlay logic inference in the same pass, by the same algorithm.

After hours of searching, the best thing I've found is free "treebank" files. Those files provide thousands of sentences whose words and sentence parts are annotated by: "noun", "verb", "adjective", "propositional phrase" and similar gradually granulated stuff, like in the following code:

Code
(S (NP (NNP John))
   (VP (VBZ loves)
       (NP (NNP Mary)))
   (. .))

From those files I can automatically construct the grammar for English language. The good news is that treebanks are popular on the web, maintained by influent organisations like universities, and they exist for a lot of different languages. I was hoping for some BNF-like rules, but I'll probably use treebanks if nothing else doesn't pop out. Maybe even to provide an arbitrary-treebank-use as a seed for generating grammar rules. Users might like it.

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1365
  • Humans will disappoint you.
    • Home Page
Re: NLP English resource missing
« Reply #3 on: February 24, 2016, 07:26:08 pm »
Here are two of the most advanced open source English parsers that are currently available.

http://ilexir.co.uk/applications/rasp/

http://www.nactem.ac.uk/tsujii/enju/

I've also written an extensive C library that parses English according to the rules laid out in "The Cambridge Grammar of the English Language" which is the most modern and complete descriptive grammar yet published. However it's still a work in progress and I'm not ready to release it yet. Here's an example of the output of my program:

<Clause>
   <Subject Clause_type='declarative' Number='plural' Person='third' Verb_type='complex_intransitive'>
      <Nominal Number='plural'>
         <Noun_BOX Case='plain_case' Category='common_noun' Number='plural' Number_type='count'>Boxes</Noun_BOX>
      </Nominal>
   </Subject>
   <Predicator Clause_type='declarative' Number='plural' Person='third' Verb_type='complex_intransitive'>
      <Verb_REST Number='plural' Person='third' Verb_form='present' Verb_type='complex_intransitive'>rest</Verb_REST>
   </Predicator>
   <Subjective>
      <Preposition_ON Category='preposition' Selects='Preposition_ON' grammaticised='yes' particle='yes'>on</Preposition_ON>
      <Determiner>
         <Determinative>
            <Determinative_THE Category='definite'>the</Determinative_THE>
         </Determinative>
      </Determiner>
      <Nominal Number='singular'>
         <Noun_TABLE Case='plain_case' Category='common_noun' Number='singular' Number_type='count'>table</Noun_TABLE>
      </Nominal>
   </Subjective>
</Clause>


 


OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

287 Guests, 0 Users

Most Online Today: 376. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles