[goaty]

the more generalized your cells are in your net,  the more they fire therefore the less you need,  but if you ever OVER generalize, the system breaks down and will become nonfunctional.

[LOCKSUIT]

https://openai.com/progress/

Open AI's amazing releases have maybe a pattern, they release one every so often on their website:

OCTOBER 15, 2019
SEPTEMBER 17, 2019
APRIL 23, 2019
APRIL 25, 2019
FEBRUARY 14, 2019
DECEMBER 14, 2018
JULY 30, 2018
JUNE 11, 2018

aha, first pattern, the visual image competition transformers and MuseNet transformer for music where released so close in time. 2 days apart.

1 5 2 2 0 5 1

There's the months between each release! 1 months.....release....5 months......release.. . . . .

Looks like it usually 2.5 months (75). Which was the number of days they released each stage of GPT-2 for the 4 model sizes!!!!! COOL!

And since their releases have been so amazing lately, its very very likely the next will be as interesting, if not greater of course!

I still don't know why the below one wasn't in their main ones, this is big achievement, i added its date above therefore:
https://openai.com/blog/sparse-transformer/

Of course korr will immediately deem this more marketing campaign business The recent Safety Gym was another. But maybe they are just proactive.