Wordnet or similar needed

  • 22 Replies
  • 9879 Views
*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Wordnet or similar needed
« on: January 29, 2013, 04:30:12 pm »
I'm messing around with some bot stuff and would like to get my bot to be able to define a word.

I'm using VB, but can't find any examples of how to use Wordnet.  I can't even download it, as the links are dead at Princeton...

http://wordnet.princeton.edu/wordnet/download/current-version/#win

I'm looking for something like COM or a DLL to search for words.  Not getting very far though.

Ideas anyone ?

*

Bragi

  • Trusty Member
  • ********
  • Replicant
  • *
  • 564
    • Neural network design blog
Re: Wordnet or similar needed
« Reply #1 on: January 29, 2013, 05:34:46 pm »
http://wordnet.princeton.edu/wordnet/download/current-version/#win
this is where you can download the database files and app for windows. Best to download version 3 and replace the db files of the windows app so that it works with the latest version.


http://wordnet.princeton.edu/wordnet/related-projects/#.NET
here you can download .net and com libraries that provide the data in your own app.

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: Wordnet or similar needed
« Reply #2 on: January 30, 2013, 01:31:33 pm »
Thanks. Yes I found those pages but yesterday the links did not work, today they are :)

*

Bragi

  • Trusty Member
  • ********
  • Replicant
  • *
  • 564
    • Neural network design blog
Re: Wordnet or similar needed
« Reply #3 on: January 30, 2013, 02:04:29 pm »
strange

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: Wordnet or similar needed
« Reply #4 on: January 30, 2013, 06:22:21 pm »
Got it going finally.  8)


*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 322
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Wordnet or similar needed
« Reply #5 on: June 22, 2015, 12:58:45 am »
To really use the word net data in my app I used ultra hal as a plugin for my vb app.
Then I extracted the nouns and verbs from the text .dat files
Then I used the list to extract the hypernyms and other nyms to a database table in Ms access ...
Then I wrote my own program to used the database that was created .... Removing the wordnet and ultra Hal components ...,
The concept net open mind common sense module is easier to do .... And the same type of table structure can be created as the word net but the common sense data is not clean many many mistakes ... But the conceptual model is fine and you can extend the predicates to many more than they have used ...,,

The lists of nouns can be used to create learning patterns , which can be used to create predicates which intern will detect new nouns ....

Mad little. Circle ... But with a list of nouns you can go a long long way ....

*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 322
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Wordnet or similar needed
« Reply #6 on: June 22, 2015, 01:04:10 am »
Understanding data laws , you may find that after data has been through transformations and restructuring / extract / transform : load then the data is really new data .... Therefore it's yours to do with what you will ...
As long as it's not personal details ....
Often newspapers or data providers will resell data after it has been segmented or transformed to businesses looking for specific information ... Without citation ... To the original sources ... A fine line in data protection ...

Yet ; Facebook sell their traffic data etc .... And then often you will find a site selling Facebook and Twitter data combined neatly into new formats ....

*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 322
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Wordnet or similar needed
« Reply #7 on: June 22, 2015, 01:04:21 am »
All transformers

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1723
    • mind-child
Re: Wordnet or similar needed
« Reply #8 on: July 03, 2015, 12:23:17 pm »
Not sure if this fits, but here is a short list of ontologies with definitions of different notions:

http://dbpedia.org/About
http://babelnet.org/
http://www.freebase.com/
http://people.mpi-inf.mpg.de/~gdemelo/yagosumo/

Some of them are of >500MB size, so I'm not sure about their usability.

*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 322
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Wordnet or similar needed
« Reply #9 on: July 03, 2015, 09:37:13 pm »
I've also used a couple of these resources and their usability is exactly the problem ... Plus the data once you get in is also badly formatted ...
To open you can use a cloud computing service (processing takes place in the cloud) that's when the formatting hits you in the face ... I think they also know .... Or they would have subsets much smaller to download and try ...

Data is no good if you have to write a program to extract the information again ...

*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 322
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Wordnet or similar needed
« Reply #10 on: July 03, 2015, 09:38:17 pm »
Especially dbpedia

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1723
    • mind-child
Re: Wordnet or similar needed
« Reply #11 on: July 12, 2015, 07:52:12 pm »
dbpedia can alternatively be downloaded in json or csv formats also. Processing them should be simple thing to do, as those are widely accepted textual formats.

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1723
    • mind-child
Re: Wordnet or similar needed
« Reply #12 on: July 19, 2015, 12:00:49 am »
I'm having a few YAGO-SUMO files in tptp format right here in text editor. The most interesting are:
  • "wordnet-classes.tptp" (enumeration of classes and their properties as in object oriented programming language)
  • "means.tptp" (mappings from text representations to symbols used in other files)
  • "type.tptp" (says which specific objects belong to which classes)
Other files are just a bunch of very narrow selection of properties of objects with their values, I think not very usable for general knowledge base, but who would know it...

To read tptp files you need a parser for tptp. If you don't have one (I didn't find any at a quick look), you can build your own parser for tptp with a variety of *parser generators* for different languages (including c#), but you have to provide tptp grammar syntax that can be found on TPTP home page.

Once you can parse tptp files of interest, I guess the next step is to construct and upload usable records to mySQL database on server because one cannot expect users to download at least 3GB of data each time she/he boots up an interface engine of a smartbot. When the data is online, a nice solution would be a partial download of a bunch of records related to current theme of which user want to talk about (some crowdsourced statistical analysis of record importance would apply here).

I am satisfied with YAGO-SUMO. It has what I expect and can be used as a starting knowledge representation for a smartbot of next generation.

P.S.
As of class description, there is class-subclass enumeration, but you have to clue up by yourself which properties belong to which class. There is just enumeration of possible values that belong to specific properties, not tied to any class...
« Last Edit: July 19, 2015, 12:08:13 pm by ivan.moony »

*

infurl

  • Administrator
  • ***********
  • Eve
  • *
  • 1365
  • Humans will disappoint you.
    • Home Page
Re: Wordnet or similar needed
« Reply #13 on: July 19, 2015, 10:31:29 pm »
I've been working with different versions of Yago over the years and can handle Yago2 pretty easily with the software that I've written for it. However Yago3 is available now and it is 91GB uncompressed. Have any of you tried working with Yago3 yet?

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6855
  • Mostly Harmless
Re: Wordnet or similar needed
« Reply #14 on: July 24, 2015, 05:24:10 pm »
I had not heard of Yago, it looks very useful. Currently do you have to download everything or is anyone running it as an online service ?

 


OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am
Nvidia Hype
by 8pla.net (AI News )
December 06, 2023, 10:04:52 pm
How will the OpenAI CEO being Fired affect ChatGPT?
by 8pla.net (AI News )
December 06, 2023, 09:54:25 pm
Independent AI sovereignties
by WriterOfMinds (AI News )
November 08, 2023, 04:51:21 am
LLaMA2 Meta's chatbot released
by 8pla.net (AI News )
October 18, 2023, 11:41:21 pm

Users Online

229 Guests, 0 Users

Most Online Today: 291. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles