Question about how chatbots form language output.

  • 25 Replies
  • 10776 Views
*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Question about how chatbots form language output.
« on: March 14, 2017, 05:38:53 pm »
I really tried searching Google and read articles, Wikipedia, etc, and didn't find an answer.


#1 - Do any chatbots use Hidden Hierarchical Markov Models or the likes? Or just Databases and questions>answers? :(

#2 - Do you make some of its words/sentence-forming permanently rewarded so it says certain things ex. likes talking about construction working?

#3 - Do they create brand-new never entered sentences or pre-installed sentences?


I want a HHMM/similar (parse-trees) chatbot that recognizes word by letters, then sentence by which words heared, then topic by sentences, and then uses its rewarded parse-tree words to REVERSE the network so it ignites the topic it loves which ignites the sentences and therefore the words and the phonemes to then speak/write (once know words it knows which phonemes to speak/write).

Then I want the rewarded words/topics in itself to self-ignite and talk on its own at random times - always new talk by its old output entering.
Emergent          https://openai.com/blog/

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: Question about how chatbots form language output.
« Reply #1 on: March 15, 2017, 03:41:46 pm »
1. Some do that I've experimented with in the past. At least there were some basic Markov elements contained in the plug-ins that allowed the bot to better handle various input. While the Markov wasn't exactly hidden, it was working in the background within the confines of the plug-in.

The same bot also allowed for a variety of pattern matching, internet searching and using "learned" data based on previous conversations. If it determined that it had some useful data that would relate to the current discussion it would often use that information to help with the conversational flow.

2. Within some bots one can assign a "weighted" system so that the bot will use one response over another perhaps less important one. The botmaster can easily assign these weights within the scripts. These weights might tend to serve more of a useful priority than an actual reward.

3. Pre-installed sentences. A bot will usually create sentences based on those it matched during it's pattern search routine (looking for the best match based on the input it received). No bots that I've experimented with were able to "create" anything new but can and will often combine some thoughts together based on previously entered snippets, words or sentences.

Remember, a bot is a glorified pattern matching program. For the present time, no bot is able to create something from nothing. It has to have something, some data from which to draw upon.

In fact humans usually call upon previously used fragments or parts of sentences or statements for their output.

Check out UltraHal from Zabaware, Jeeney from Jeeney.com, RiveScript (rivescript.com) and of course some other great bots like Mitsuku (mitsuku.com) and SkyNet-AI (http://skynet-ai.com/).

Hope this helps a bit.
In the world of AI, it's the thought that counts!

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Question about how chatbots form language output.
« Reply #2 on: March 15, 2017, 09:21:19 pm »
Watch I can indeed create brand new never EVER written sentences (at least that I've never seen/thought of).

Watch how every word is different. And watch how, if two common words are together, then the next are separate i.e. it's pasting "2s" together just not "1s". Picking out 2 sentences to line-up is the same thing i.e: Lady Gaga. Good evening.

Here we go:
I am la chin friedo minister so kooooooos-ta uma jungle vixen teeth ho ox sand mitten loop tala bica cheena pala gabu gjrfj theujeuje g w i i t 6 7 ^ & % 4 5 z r z r zr z r.
That should do it.

Ok so let me go faster so I don't "think":
je brada minky tela dood nu monh vt Asv Free minu totla doodle bees bum to ca bullia.

Just to be safe let's use real words, no stopping:
hop pick me doodle why you bunny me pee deeble dop bog cat minitster meen been mop loop in me dog mop bop cat me dog fox why to the moon pool hop hop hole dole doodle.

My theory is the "tree" has a probalistic way that it will, by each words strength, pick which word first, then after that word the next strengths changes and so the next one sequentially gets selected.

Imagine someone saying something they most want to say. They'll never say anything else on their own ex. "turn left and go straight to get to the store" - only "give me food". The answer stored is not strong enough, until matched by input i.e. some stranger. And if that isn't enough, then seeing example hobos may match a strong positive memory that gets remembered and linked to their question and so your stored correct positive answer, combined with being matched, and this positive additive, makes you say the answer.
Emergent          https://openai.com/blog/

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: Question about how chatbots form language output.
« Reply #3 on: March 16, 2017, 02:29:07 am »
Sorry to say but in your first example, those words have no real intelligible meaning(s).

In your second example, you indeed did use common words that already have established meanings (for the most part).

Third, what you believe to be original is anything but. What ever word(s) you choose to use in a sentence (aside from some made up meaningless words, have already been used by others in a variety of many ways.

Bottom line, your thoughts, even though they might be yours, are not of your Free Will. In fact, there's no such thing.

So study some other bots and A.I. experiments out there and begin to formulate your own, whether AIML, C#, C++, LISP, RiveScript, ChatScript, SuperScript or any other language that will work for you.

Until you can come up with a way for your (yet to be created bot) to create it's own language, with understanding of context, you should really study some of these other examples. Otherwise, it's 10% programming and 90% scripting!
(or something like that).
 Good luck!
In the world of AI, it's the thought that counts!

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Question about how chatbots form language output.
« Reply #4 on: March 16, 2017, 08:21:07 am »
We don't have free will - I definitely wasn't saying we do.

I wasn't saying the words meant anything, and I wasn't saying they were never used.

What I was saying is that the word after word is unique - for example I have never seen this > Loop brown weener jackerlantern job for house. Which came out of my mouth/mind all in order (well this one not too fast but the others yes [3rd/2cd one]).
Emergent          https://openai.com/blog/

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Question about how chatbots form language output.
« Reply #5 on: March 16, 2017, 12:50:22 pm »
Hmm, no free will. What did you both have for breakfast ?

*

kei10

  • It's a honor to meet everyone!
  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 430
  • Just kidding.
Re: Question about how chatbots form language output.
« Reply #6 on: March 16, 2017, 12:56:34 pm »
Hmm, no free will. What did you both have for breakfast ?

Pffffttt XDD
Greetings, signature.

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Question about how chatbots form language output.
« Reply #7 on: March 16, 2017, 12:59:41 pm »
Same thing every morning - waffles.

Lunch: McCain frozen fries, 4 frozen nuggets, root-beer *POP, Chip Ahoy chewy cookies & 2% milk.

Next day's Lunch 1/2 a hotdog & 3 buns w root-beer *POP and then cupcake bottoms (little a tops too) & 2% milk, then the other lunch the next day.

Dinner: 6 Oatmeal muffins.

Repeat.

I mean, muffins with 2 Berry Punch Minute Maid juice boxes

Me and Art think the same !

I might be in range of thinking about a Language-only AI. Working working working. Also another way, maybe.

I'm always thinking how I will take over Earth.
Emergent          https://openai.com/blog/

*

Art

  • At the end of the game, the King and Pawn go into the same box.
  • Trusty Member
  • **********************
  • Colossus
  • *
  • 5865
Re: Question about how chatbots form language output.
« Reply #8 on: March 16, 2017, 02:43:29 pm »
I knew my posting would stir the pot, so-to-speak but it's always interesting to look at both sides.

@ Lock...sorry about your lifestyle / eating habits. Then again, you are a very young man and aren't likely to see the error of your ways for at least a few more decades...and believe me, you will.

While we might share an idea or two that run along similar threads, to state that we "think alike" is both inaccurate and presumptuous.

With regard to my intake:

My intake - an average day -

Breakfast - soft boiled egg & a few crackers, coffee OR oatmeal & piece of toast, juice and coffee.
Lunch - small salad (lettuce, tomato, onion) w/ tuna salad & few crackers OR homemade vegetable soup and small salad.
Dinner - small grilled fish filet, vegetables and half a sliced avacado & water w/ lime juice.

No processed food, no High Fructose Corn Syrup limited GMO's and limited white food intake (white bread, pasta, potatoes, rice), No soft drinks, plenty of water.

So no...we do not think alike when it comes to what we put into our bodies.

############################
There are always two schools of thought on practically every subject, theory and ideology. The one about Free Will or lack thereof, has been around for many years.

One excerpt of the following link is as follows:

Many scientists say that the American physiologist Benjamin Libet demonstrated in the 1980s that we have no free will. It was already known that electrical activity builds up in a person’s brain before she, for example, moves her hand; Libet showed that this buildup occurs before the person consciously makes a decision to move. The conscious experience of deciding to act, which we usually associate with free will, appears to be an add-on, a post hoc reconstruction of events that occurs after the brain has already set the act in motion.

I suggest one read the following posting: https://www.theatlantic.com/magazine/archive/2016/06/theres-no-such-thing-as-free-will/480750/
In the world of AI, it's the thought that counts!

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Question about how chatbots form language output.
« Reply #9 on: March 16, 2017, 02:57:07 pm »
Have you heard of the book Diceman ? It's interesting in that the main character leaves his decisions to the roll of a dice.

Free will is an interesting subject, personally I think we have it. I could go on, but I am going to exercise my free will and postpone further comment until I have played a few more hours of my game. That's a decision on my part, my free will, electrical impulses and all.

You are all of course allowed to exercise your free will and reply or not ;)

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Question about how chatbots form language output.
« Reply #10 on: March 16, 2017, 06:58:37 pm »
Here's 3 good examples of 0 free-will:

You automatically carry out pre-installed laugh/cry actions and more so when put sugar/needle on tongue more so.

Sugar or rubbing back sends signals, this stuff is not actually elementally "feels good/pretty/tasty" because no particle arrangement can be, simply you are rewarding actions, doing actions on pattern recognition/self-ignition, and using a language neural network to say all your English-language words.

Your eyes automatically follow a moving target (only when moves otherwise won't happen) by the smooth pursuit mechanism.
Your eyes stay in place as move head by the Vestibulo–Ocular Reflex system.
Further my latest discovery is that when you look around the room while NOT moving eyes/body, and start moving forward, you can keep looking at the area by the same mechanism - the visual difference re-adjust the highlight area of the images like it re-adjusts the eyes.
Emergent          https://openai.com/blog/

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Question about how chatbots form language output.
« Reply #11 on: March 16, 2017, 08:30:10 pm »
I think there must be free will because of your creative use of the English language Lock  ;D ;)

Are both of you telling me we go through life without making choices for ourselves ?

*

LOCKSUIT

  • Emerged from nothing
  • Trusty Member
  • *******************
  • Prometheus
  • *
  • 4659
  • First it wiggles, then it is rewarded.
    • Main Project Thread
Re: Question about how chatbots form language output.
« Reply #12 on: March 16, 2017, 08:33:16 pm »
1. Yes.

2. Hope robot don't make new major decision like you suggested.

In other words we are, who we are. We are.....we are....we... are. . .

But don't set yourself to now walk lop-sided everywhere you go~
Emergent          https://openai.com/blog/

*

Freddy

  • Administrator
  • **********************
  • Colossus
  • *
  • 6860
  • Mostly Harmless
Re: Question about how chatbots form language output.
« Reply #13 on: March 16, 2017, 08:37:01 pm »
OK then I am banning you and demoting Art.

*

Korrelan

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1454
  • Look into my eyes! WOAH!
    • YouTube
Re: Question about how chatbots form language output.
« Reply #14 on: March 16, 2017, 08:41:56 pm »
@ lock

Total and utter boll*cks... as usual

Do you even think... before you post?

Quote
In other words we are, who we are. We are.....we are....we... are. . .
But don't set yourself to now walk lop-sided everywhere you go~

I am growing tired of your... spouts.

Explain.

 :)
It thunk... therefore it is!...    /    Project Page    /    KorrTecx Website

 


Requirements for functional equivalence to conscious processing?
by DaltonG (General AI Discussion)
November 19, 2024, 11:56:05 am
Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

247 Guests, 0 Users

Most Online Today: 362. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles