Inception blocks behaviour

  • 3 Replies
  • 2305 Views
*

Kaeldric

  • Guest
Inception blocks behaviour
« on: June 03, 2018, 03:01:19 pm »
Hello.

I'm studying the GoogLeNet by implementing a personal implementation in Tensorflow.
Last day I introduced a bug and changed the structure of the inception block a little.
Before that the algorithm run very poorly ... actually it never learned anything.  :(
After the modification (that changed the structure from the official paper one) the network start working as a charm  8) (with a little overfitting, but this is another story)!

You can find the two different structures here ---> https://imgur.com/a/vQiy0Te
where the bad one is the inception block described in the original paper and the good one is the modified version.

Is there a way to know why this modification leaded to a such big performance improvement?  ???

Thank you.  :)


*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 325
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Inception blocks behaviour
« Reply #1 on: June 03, 2018, 06:16:21 pm »
Hello.

I'm studying the GoogLeNet by implementing a personal implementation in Tensorflow.
Last day I introduced a bug and changed the structure of the inception block a little.
Before that the algorithm run very poorly ... actually it never learned anything.  :(
After the modification (that changed the structure from the official paper one) the network start working as a charm  8) (with a little overfitting, but this is another story)!

You can find the two different structures here ---> https://imgur.com/a/vQiy0Te
where the bad one is the inception block described in the original paper and the good one is the modified version.

Is there a way to know why this modification leaded to a such big performance improvement?  ???

Thank you.  :)

In this case the picture does not tell a thousand tales .... the pictures do not have enough information to make any sound judgement...at a glance its obvious that optimising the structure has made a difference although immeasurable but the information contained in the picture

*

Kaeldric

  • Guest
Re: Inception blocks behaviour
« Reply #2 on: June 03, 2018, 11:50:19 pm »
In short .... there is no way to know.  :)

*

spydaz

  • Trusty Member
  • *******
  • Starship Trooper
  • *
  • 325
  • Developing Conversational AI (Natural Language/ML)
    • Spydaz_Web
Re: Inception blocks behaviour
« Reply #3 on: June 04, 2018, 07:21:41 am »
In short .... there is no way to know.  :)

So a futile question

 


Requirements for functional equivalence to conscious processing?
by DaltonG (General AI Discussion)
November 19, 2024, 11:56:05 am
Will LLMs ever learn what is ... is?
by HS (Future of AI)
November 10, 2024, 06:28:10 pm
Who's the AI?
by frankinstien (Future of AI)
November 04, 2024, 05:45:05 am
Project Acuitas
by WriterOfMinds (General Project Discussion)
October 27, 2024, 09:17:10 pm
Ai improving AI
by infurl (AI Programming)
October 19, 2024, 03:43:29 am
Atronach's Eye
by WriterOfMinds (Home Made Robots)
October 13, 2024, 09:52:42 pm
Running local AI models
by spydaz (AI Programming)
October 07, 2024, 09:00:53 am
Hi IM BAA---AAACK!!
by MagnusWootton (Home Made Robots)
September 16, 2024, 09:49:10 pm
LLaMA2 Meta's chatbot released
by spydaz (AI News )
August 24, 2024, 02:58:36 pm
ollama and llama3
by spydaz (AI News )
August 24, 2024, 02:55:13 pm
AI controlled F-16, for real!
by frankinstien (AI News )
June 15, 2024, 05:40:28 am
Open AI GPT-4o - audio, vision, text combined reasoning
by MikeB (AI News )
May 14, 2024, 05:46:48 am
OpenAI Speech-to-Speech Reasoning Demo
by MikeB (AI News )
March 31, 2024, 01:00:53 pm
Say good-bye to GPUs...
by MikeB (AI News )
March 23, 2024, 09:23:52 am
Google Bard report
by ivan.moony (AI News )
February 14, 2024, 04:42:23 pm
Elon Musk's xAI Grok Chatbot
by MikeB (AI News )
December 11, 2023, 06:26:33 am

Users Online

381 Guests, 0 Users

Most Online Today: 597. Most Online Ever: 2369 (November 21, 2020, 04:08:13 pm)

Articles