OpenAI Speech-to-Speech Reasoning Demo

  • 3 Replies
  • 114803 Views
*

MikeB

  • Autobot
  • ******
  • 224
OpenAI Speech-to-Speech Reasoning Demo
« on: March 15, 2024, 08:14:02 am »
This is trending #11 on YouTube.

Speech has a solid three second delay, and responses are what you expect from the statistical analysis and middle-average contextual analysis approach.

It would be a whole new layer of interesting if responses included the own robots' survival instinct, like throwing in a few "what about me?" and "have you seen my charger?" responses, but maybe that's a bad look or conclusions could be drawn about the danger of AI in a physical sense.


*

8pla.net

  • Trusty Member
  • ***********
  • Eve
  • *
  • 1307
  • TV News. Pub. UAL (PhD). Robitron Mod. LPC Judge.
    • 8pla.net
Re: OpenAI Speech-to-Speech Reasoning Demo
« Reply #1 on: March 28, 2024, 01:23:07 pm »
A Few Constructive Criticisms:

In my opinion, it seems...
  • Everything (robot, table, items) has a fixed location.
  • The stimulus is scripted for keyword recognition.
  • The responses are simply a generative AI application.

These criticisms are not complaints about this video.
They are for chat purposes about how this may work.

Are my opinions, correct or incorrect?  What do you think?

My Very Enormous Monster Just Stopped Using Nine

*

ivan.moony

  • Trusty Member
  • ************
  • Bishop
  • *
  • 1729
    • mind-child
Re: OpenAI Speech-to-Speech Reasoning Demo
« Reply #2 on: March 28, 2024, 01:31:53 pm »
Are my opinions, correct or incorrect?  What do you think?

I believe you're correct about fixed locations, but not in extent to pre-scripted actions, yet the bot may be super-trained to shown specific inputs/outputs. It is yet to be seen how the bot behaves in stressed, unknown conditions.

But overall, that kind of bot body seems like a big step forward, reserved only for Boston Dynamics by now. Training on what to do with the body may be mere formality for ANNs.

Is anyone aware of what software tech Boston Dynamics used for, say, Atlas?

*

MikeB

  • Autobot
  • ******
  • 224
Re: OpenAI Speech-to-Speech Reasoning Demo
« Reply #3 on: March 31, 2024, 01:00:53 pm »
The items are not in a pre-programmed/fixed location. Advances have been made in machine vision, so basically anywhere nearby in view is good enough to identify the item. Eg. the physical appearance. Whether the item is relevant to contextual conversation is another matter.

But the engineer in me shudders at the thought of comparing millions of images just to identify the probability of an item in view....

Advanced, but can't say any advancements have been made

 


LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

281 Guests, 0 Users

Most Online Today: 303. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles