NVIDIA llama3-70b Model

Jalali HartmanPosted oninArtificial Intelligence

Did hardware NVIDIA giant just signal that they are not getting into the language model race with Google and OpenAI? Try out their new A.I. chat on their website or here is the python code to try it. 

from openai import OpenAI

client = OpenAI(
  base_url = "https://integrate.api.nvidia.com/v1",
  api_key = "$API_KEY_REQUIRED_IF_EXECUTING_OUTSIDE_NGC"
)

completion = client.chat.completions.create(
  model="meta/llama3-70b-instruct",
  messages=[{"role":"user","content":"Write a limerick about the wonders of GPU computing."}],
  temperature=0.5,
  top_p=1,
  max_tokens=1024,
  stream=True
)

for chunk in completion:
  if chunk.choices[0].delta.content is not None:
    print(chunk.choices[0].delta.content, end="")
Jalali Hartman
Latest posts by Jalali Hartman (see all)

Jalali Hartman

Jalali Hartman is the founder of Robauto.ai. Since 2013 Robauto has been providing robotics education, news and innovation in the fields of robotics and Artificial Intelligence. He is a thought leader, TedX speaker and expert in algorithms and human-robot interaction.