[John Oezbay]

Here I am with a new topic.
First, let me introduce myself a little bit, I'm a Music Technologies undergraduate student, and I live in Turkey.
I first met ALICE about 7 years ago.. (wow.. never thought about that before... )
and I'm a Mac enthusiast... I had my second year thesis on Voice Recognition, and Mac OS X has a great native voice recognition support in it.

After watching Iron Man, and completing my thesis on Voice Recognition, a bright light bulb appeared on my head, and I said, yes! That's AppleScript ! (I really liked JARVIS, but there are so many major flaws in the movie about that too... First was, Jarvis was deciding on his own, second was, even with a loud music in the room, Jarvis was able to understand what tony stark said.. WHICH is completely impossible with the current technology we have... )

But, I have this project and I think there are many more peoples out trying to do the same. I have already contacted them through their blogs, but haven't received any answer yet..
I found a way of creating something like JARVIS ! But like I said before, it can't hear you if there is music, or noise in the room.
Before starting to tell about this project, here are the things we're going to need. (yes I also have an Instructables account )

1) A Mac Computer
2) AppleScript : AppleScript is a great way of automation. It is also a cute programming language. You can integrate any other language in it too. But the main purpose of AppleScript is to connect all the programs together, and share common things. Like your address book, mail, calendar, iTunes Music, iPhoto photographs etc. (Almost every software that runs on Mac OS X) {info sharing scenario : You have received an e-mail from Jack Shepard (yes I'm a LOST fan... ). He's telling you to come to the Hospital, because his sister is giving birth. We can make AppleScript get the hospital's address from the internet and show it in Google Earth. Or we can get Jack's sisters face from iPhoto... }
3) Java : Because ALICE is Java-Based, and Java is much more easier to integrate into AppleScript than C or C++ is for me, some Java knowledge will be needed.
4) Wikipedia : In the "Shared Computing AI Topic" I have seen people talking about a Bot, searching the internet and learning from it. Why not use the free Wikipedia database instead of making the bot search things online ? Wikipedia's database is free, and downloadable. I know people who downloaded wikipedia into their iPhone, and created a "Hitchhikers Guide to the Galaxy" with their iPhone. Even some of them laser scribed : "Don't Panic" on the back of their iPhones...
5) iPhone OS 3.0 / Objective - C : in some part of this project, our so called Jarvis could contact us back even while we're away from our computer. And iPhones are great for this, because they are highly user-friendly compatible with Mac's...

Now about the project and what I did in the past 2 years.
I have a Mac Pro running Mac OS X Snow Leopard 24/7 to serve me. I have written a lot of AppleScript codes, running simultaneously with the mac's Voice Recognition. Here are some examples of what I can do with this.
U = User
C = Computer

Whenever I get into my house, my iPhone connects to my Wi-Fi network. And whenever my computer sees my iPhone ;
C = Hello John, welcome home. What can I do for you?
U = Hello, play some Jazz...
C = All right, hope you like it... (and starts playing iTunes Genius Jazz Playlist) ( It plays whatever I say)

U = Play, Jan Garbarek - One Goes There Alone
C = (Plays the song)

U = Play, Miles Davis
C = Any specific song or album?
U = Blue In Green (At this point, if there is only one version of Blue In Green, computer plays it, if there are two =>  )
C = The Concert Version ? or the Studio Version ?
U = The Concert Version ( Again if there is only one Concert Version, it plays it, or I can specify it in the beginning )
C = Montreux Jazz Festival ? or Royal Hall ?

U = Play, Bill Evans
C = Any specific song or album?
U = Play the one ft. Tony Bennet (yes I can do that too:D )

This is just an example from iTunes integration of my House Control System.
Here is another one :

If the electricity goes out while I'm at Work or School, the UPS signal triggers an AppleScript, it e-mails me to inform that the electricity is out. and shuts down the computer.
I check out my iPhone, and see that the electricity is gone. (So the Torrent traffic stopped )
When the electricity comes back, the computer automatically powers on, e-mails me that the electricity is back, If I reply to that e-mail with the subject "Shut Down"
The computer shuts down. If I reply :

"Launch Vuze, and keep downloading" it launches Vuze.
"Run System Check" it runs a system check-up.
"Launch Adium" skype, toast etc. Here is the best part, The AppleScript checks for the Apps name. So I don't need to write specific scripts for each app I have. It can launch all the applications I have in my computer.

If I reply "Let me in"
It starts a VNC Server, Sends me my current IP Address, so that I can log in using my Jaadu VNC from my iPhone over 3G, and control my computer.

These some implementations I have made.

OK, now these aren't AI right ? It has to decide...
So here comes ALICE, and the part, I couldn't figure out how to do it..

How about if we integrate ALICE and Wikipedia into this system ? We can literally "speak with our computer to make it do our job"
Java Knowledge needed here...

After these modifications, lets see what we can do with it.
We can say : Hey Whats the Black Smoke?
C = (picks up a result from Wikipedia , or even picks up a theory from LOSTpedia, and replies = > ) : I think the black some is not a monster... ( I really don't want to give spoilers about the series )

or we can say : Where's the Albert Hall ?
(checks out what albert hall is, picks up the address, opens that address with google earth)
C = Is this information correct ?
U = Yes, thats correct.
(And after having some correct information from the same source which is wikipedia, it starts picking up from that source)

YES THIS IS ALL POSSIBLE! and the only thing that stops us here is, that we're unorganized, independent BOT programmers? Why not organize, and form one big great bot? Why separate bots ? Why the show-off ? Lets build this thing open sourced? It's not that hard. ?

So here is the project. . .

and how to accomplish this?
We need to organize.
I need some Java assistance,
some knowledge about how wikipedia and -pedia sites work.
some web knowledge.
and here it is.. our own JARVIS ?

We can even speak to it just like Tony Stark does, while he is in the suit... Our suit , is the iPhone... We can connect to our computer, with our iPhone, and we can speak to it, wherever we are... Even on the other side of the world... (If 3G exists there)

So who's with me ?

I would like to thank everyone who read all these,
I would like to say sorry, for my English, forgive me for my mistakes.
and thanks to this great forum, finally a common place for AI lovers to share their projects and ideas and knowledge.

Feel free to contact me about anything through PM, I have MSN Messenger, Skype, a Google Wave Account(yes I can send invitations too),and a Facebook account (dunno if that helps ? ) just pm me, i'll send my contact details to you;)

I'll be waiting your replies

[Data]

John, this post has blown me away, your level of programming skills and what you have accomplished so far is pretty awesome. A lot of what you have said is way over my head, but I like the way you are thinking.

I don’t think this reply really gives your post justice but be aware I have read it and it is making me think.

I am with you but don’t think I could help any more than testing things and maybe some web knowledge.

Others here, given time to digest your post, should be able to assist you more.

Good luck 

[John Oezbay]

This place is awesome. I'm serious. Dunno If you've ever heard of the Hacker Manifesto ? Well it ends with these sentences : "I am a hacker, and this is my manifesto.  You may stop this individual, but you can't stop us all... after all, we're all alike." I kind of remembered that in a pretty good way. What I'm trying to say is : one thing is for certain! We're all alike! I think this is the most comfortable forum I have ever joined. It feels just like home.

Anyway,
I have two months in front of me. I'm also trying to finish my term project.
Last month I built a "reactable". Google it;) I wanted to build a better interface than reactable. so I found the "g-speak" project. (google : g-speak oblong)
G-Speak is basically the "Minority Report-way of computing" It's easy to build except the super-complex math... Reactable's software is pretty much the same, so I think I'm going to mix it with the reactable engine. Well if it works, I'll post you guys a video Then, I'll unplug my mouse and keyboard. If I could, or we could somehow build this AI, it will become the coolest, smartest way of computing of our era. Control your windows by waving your hands, tell your computer to do your daily jobs, play your favorite song, and as a future integration house control ? well here comes "ALICE what time is it ?" - "It's tea time sir!" - "Well you know what to do..." "Right away sir!"  ** a little clink noise, means, your hot water is waiting for you

I know this sounds pretty futuristic, but it's actually not.. Technically we're living in THAT future, which we dreamed 8 - 10 years ago.
Oh sleepless nights.. I think I'm going to take a good sleep. It's 2AM :|

Now you know the future of this project It'll be fun testing it
Thanks, Datahopa

[Freddy]

I agree, your work thus far sounds great - well done  

There's quite a few programmers visit here now, I hope everyone can throw some ideas around.  Most of my programming at the moment is in PHP - so currently I am able to help members with things like that - setting up a website etc.  And of course testing things would be okay with me too.

Good fortune  

[John Oezbay]

Hey there,
someone actually made what I planned  It seems like he spent more time than I did...

Here is the link :   http://projectjarvis.com/
You should check the videos...

[Freddy]

Impressive stuff, nice website too...

Well I wouldn't give up, there's always something new to do    Doing it yourself could be very satisfying too I bet.

[John Oezbay]

Hey there !
I'm back with good news.
Finally, we became a team, and started working on the project I have been working on for a while.
Again, if there's anyone who wants to join, collaborate, feel free to contact me.

I have one question, is it possible to execute system/shell commands in aiml ?
 

[mad5ci]

Pretty impressive but I'd like to see it platform independent. It will never get out of Mac if you don't start thinking about it now. Any ideas how to port it to other systems? Is it possible? Language (AppleScript) and hardware (Mac, iPhone) says no I guess. Would be great to have it on my Linux machine. I could even do some porting stuff myself but I'll have to get some clues.

[Freddy]

Welcome back John, do you mean you teamed up with the guy who did Jarvis ?

[John Oezbay]

Thanks Freddy, no, we have gathered a completely independent team. We're just a bunch of people, who are dying to use this at home

@mad5ci :

Because AppleScript is something system-wide, and it is already implemented into thousands of applications, we don't need to code everything by hand.
For ex. with AppleScript if we want to check our e-mails, we just need :

tell application "mail" to check for new mail

So, it's English, basically... Which makes our job, extremely easy. We don't even need to code these kind of things by hand. We will just make the words "JARVIS, Get my mail!" trigger : tell application "mail" to check for new mail. Then it will say : "Hey, you have 11 new e-mails from different senders." "Would you like me to read them?" if we say "yes" it will first start by telling us who the senders are. If we interrupt and say : "hey that is a spam!" or "thats a spam", such thing like that... variations ... It will send the specific mail to the spam-box, and will warn the Mail app to do this every time a mail comes from that sender. and maybe another time the same mail arrives, it will say : " Hey John, remember that stupid -marine watch Ad-" - "yeah?" - "That address keeps sending you that mail for a very long time. and I'm deleting it" - "Cool! Thanks" just like that.

Because we're implementing an AIML bot's brain into it. and because AIML responses are "English" too, we have the ability, to make it, script itself when necessary. Reverse-Scriptability will do the most of the daily tasks...

If we wanted to do this in Windows, or Linux, we would have needed at least 10 or 20 auxilary applications for each script.

Also, iPhone is a great tool, for this job. Because we need something we can easily integrate with apple, which has wifi, 3G, and could be carried around in your pocket all the time.
OK, iPads are great alternatives too! and I really have the intention to write a GUI for iPad. Which is really easy to do, and uses the same protocol our Macs do.

But please join us through our journey. It would be great, if we could see you online with the team
Maybe you could be the first person who actually ports AppleScript to linux ?

Please contact me  

[tran1binh]

Hey John, I sent you a private message.

[Mohit]

I am dying to get this on Windows Whenever you finish it for porting it on Windows or Linux, count me in for testing.

It would be nice if it can take some notes for me, set calendar entries, memos etc if possible. I don't have a Mac, but this makes me think for buying one. 

[John Oezbay]

Hello there everyone, I know it has been a long while, and I haven't answered any of your questions Forgive me for this silence. But I have good news

Ok I'm hoping this post will answer all your questions

But first, we have formed a team on June!
Second, we have made HUGE progress!
and Third, we're about to shake the world!

I must say one thing though. We're not considering "open-source" as an option. Mainly because of two reasons,

1 ) We have made something really clever, system-wide, and system-aware, and if we open the source, it'll lead to major security problems for the system.(both now, and in the future) So the codes remain with us.

2 ) WE have been working on this project since June, day and night. (I think this is clear enough - I'm telling this, because some guy came to us, and told us that he found something super cool, and he wanted to join the project. Well we said yes, but all he did was to slow us down, and at some point, he not just slowed down the progress, also reversed it.) We are a wonderful team right now. So please don't get this wrong, but we're working on it

The system got self aware, and formatted itself (just kidding)

I know this will sound really weird, and cold, and distant.

We made a big, huge, gigantic progress, and we don't want any other trouble. (this is also for the project's own good) So I'm not going to tell anything about the project. Except that we have started using Obj-C, and again we're about to change many things. Many things you have never imagined of! And I know I sound like the guy ringing your bell trying to sell fake bottled perfumes. But don't worry guys, it's close

I'll announce the big news when we're all ready. Expect it to be ready before May I also know that this is a date in a galaxy far far away. But with the current speed, and the progress, we'll change MANY "rules" you have known.

Please be patient

AND, Mac OS X rules, I don't think any windows machine can handle this project. (maaaaayyybeee linux, but I won't be the one coding this )

Thank you everyone for your interest,
and your patient.

Cheers,

J

[Art]

So your wonderful "change the world" application will be limited to a very small percentage of users on the planet who've chosen Apple / Macs as their computer of choice...

Good luck with that!

[Mohit]

Windows isn't that bad   Might be a bit difficult to port this on Windows or to make it cross-platform, but it is possible.