NVIDIA llama3-70b Model

Did hardware NVIDIA giant just signal that they are not getting into the language model race with Google and OpenAI? Try out their new A.I. chat on their website or here is the python code to try it.

from openai import OpenAI

client = OpenAI(
  base_url = "https://integrate.api.nvidia.com/v1",
  api_key = "$API_KEY_REQUIRED_IF_EXECUTING_OUTSIDE_NGC"
)

completion = client.chat.completions.create(
  model="meta/llama3-70b-instruct",
  messages=[{"role":"user","content":"Write a limerick about the wonders of GPU computing."}],
  temperature=0.5,
  top_p=1,
  max_tokens=1024,
  stream=True
)

for chunk in completion:
  if chunk.choices[0].delta.content is not None:
    print(chunk.choices[0].delta.content, end="")

• Author
• Recent Posts

Jalali Hartman

Jalali Hartman is the founder of Robauto.ai. Since 2013 Robauto has been providing robotics education, news and innovation in the fields of robotics and Artificial Intelligence. He is a thought leader, TedX speaker and expert in algorithms and human-robot interaction.

Latest posts by Jalali Hartman (see all)

• Microsoft’s Mustafa Suleyman & a Fresh Take on A.I. - November 8, 2025
• 3I/Atlas Update - November 3, 2025
• Video Pages and Google AI - October 31, 2025