Grok Is Now Open Source
Grok is now more open than OpenAi.
Was this out of spite? We will never know the answer although the motivation doesn't matter. What we know is Elon Musk challenged OpenAI to the point where he is suing the company. We will see what the courts rule.
Regardless, we see the public pressure being applied.
It seems like one step in this process is to open Grok.
Is this the right move?
This cannot be answered since there are valid arguments on both sides. Some believe that AI should be all open source, removing the full control from single companies. Others argue that this is a mistake and a larger threat to humanity since one with nefarious intentions can cause massive damage.
Grok Opened Up For Anyone To Use
We got a few of the specifications of what was released. These are making the rounds of YouTube already.
What we have:
- 314 billion paramaters
- 8 experts
- 86 billion active parameters
- Apache 2.0 license
Here is the post announcing the release.
This is not the first open source LLM. Meta has Llama out there so this is another one for people to play with.
The key is it is general purpose without having any specific application. We will likely see this generated over the time.
Performance
This was the first version that was released back in the Fall. We were told that version 1.5 is on its way. This is not what was released so the performance will trail the other models. Of course, we will have to see what 1.5 is like, most likely being available on X via subscription.
In terms of the parameters, the will place it second behind what many project ChatGPT 4.0 at. The difference is stark meaning, when it comes to the general purpose models, OpenAI is still leading the race.
What will be interesting it see is how Grok is adapted once developers start utilizing it. There are some specialized models that were created from Llama2. It is likely we will see a similar path followed with Grok.
Why This Is Good News
To me, it is better if more is open source. We are dealing with some powerful technology and having it open means that we are not completely beholden to mega-technology companies.
Personally, I believe open source is going to win this one. The innovation that comes from the open source community is likely to outpace what the individual companies can created.
That said, open source is still trailing. One reason is they started a bit later to the game. Fortunately, they are catching up.
Another benefit is the specialization. As these LLMs are out there, specific use cases can be developed. This is likely to surpass the capabilities of the general models, at least in those fields.
My view is that the road to AGi is going to be paved by many ANI. When creating an AI for a specific purpose, the potential threat is reduced.
It seems like decentralization is a defense against vulnerabilities. Naturally, we still have the problem of the amount of compute required along with the data. At least with Grok, all that is done on X is going to be open since it will eventually be fed into Grok. Over time, with each new generation, the open model is going to be upgraded, remaining a version behind.
We are still in the early days with all this. It was about 500 days ago that ChatGPT was released. Grok is simply another step in this evolution.
Here is the present major players:
- ChatGPT
- Gemini
- Llama2
- Claude
- Grok
There are an assortment of other smaller models which are showing promise.
The next 24 months are going to be very interesting.
Posted Using InLeo Alpha
I dont know how much will OpenAI charge for Sora when it releases later this year but this is great news for AI enthusiasts.
A lot of interesting things coming. We will see how fast some of the different segments move.
Yeah interesting times coming.
Let the game begins.
I'm sure it will be soon. AI on the blockchain is pretty much on the horizon O.O. Imagine all the information on the blockchain from the AI unable to be deleted or censored by a company or anybody. It will just be there growing learning sharing and teaching to anybody that wants to get information from it.
There is already some AI on blockchains. We see bots. Remember, AI is a large topic.
The data will feed into machine learning engine and LLMs as things grow.
u know what i mean o.o. like a chatgpt on blockchain? we have that already?
LeoAI is going to use that somewhere. I am not sure what model they used, probably Llama2 and then training it using threads.
That is why I keep writing about getting more data on Leo and feeding the machine learning engine.
Ok let me know where O.O would love to use it
I think open source for this stuff is for sure the way to go. There are always doomsayers that think it will cause destruction and it likely will, but I think a lot of it is going to be destruction of centralized monopolies. There are going to be some bad actors who do nefarious things on purpose to bring a negative light to it all, but once you open the bag, it's impossible to put the cat back in it. Look at what Napster did and Limewire. This is on such a larger scale than that.
My vision for the AI future is bots for things that are incredibly important and useful such as ones dedicated to gardening and agriculture. You put in your parameters and some other datapoints and they can tell you how to optimize your soil and all that for maximum yield and soil regeneration.
I think the overall is positive. There is certainly a risk that needs considering. Whether we are or not is up to debate. However, the solution to the Skynet scenario in my opinion is to decentralize things.
For me I haven't really use that in my x app but it's good to know about it
I am not sure how integrated it is.
Well let's just see how it works then .
Congratulations @taskmaster4450le! You have completed the following achievement on the Hive blockchain And have been rewarded with New badge(s)
You can view your badges on your board and compare yourself to others in the Ranking
If you no longer want to receive notifications, reply to this comment with the word
STOPI think the more AI gets open sourced, the better. More decentralized developments and innovation. I wonder if one will be able to combine different AI models when creating ANI. It seems possible in theory.
I agree with you on this.
I agree that open source is usually better for everyone. I have read some articles about Elon and OpenAI, and how he was against their removal of their open source policy. Maybe he really believes in AI as open source, or maybe he wants to improve his PR, but in the end I think we as consumers/users benefit from this.
We will see what the truth is there. He did sue them claiming they went against the open idea. The company claims Elon was in on the switch to closed source.
Lawsuits can be messy things. But the think is that Grok is now open source so there is another on the market.