今更ながら「Transformers」に入門する ⑦TUTORIALS: Agent 101: Agents and tools

!pip install -U transformers[agents] bitsandbytes
!pip install torch

!pip freeze | egrep -i "transformers|bitsandbytes|torch"

from huggingface_hub import login, InferenceClient
from google.colab import userdata

login(userdata.get('HF_TOKEN'))  # HF_TOKENをColaboratoryのシークレットに登録しておくこと

client = InferenceClient(model="meta-llama/Llama-3.2-1B-Instruct")

def llm_engine(messages, stop_sequences=["Task"]) -> str:
    response = client.chat_completion(messages, stop=stop_sequences, max_tokens=1000)
    answer = response.choices[0].message.content
    return answer

from transformers import CodeAgent, HfApiEngine

llm_engine = HfApiEngine(model="meta-llama/Llama-3.2-1B-Instruct")
agent = CodeAgent(tools=[], llm_engine=llm_engine, add_base_tools=True)

agent.run(
    "Could you translate this sentence from French, say it out loud and return the audio.",
    sentence="Où est la boulangerie la plus proche?",
)

======== New task ========
Could you translate this sentence from French, say it out loud and return the audio.
You have been provided with these initial arguments: {'sentence': 'Où est la boulangerie la plus proche?'}.
=== Agent thoughts:

>>> Agent is executing the code below:
text = {'sentence': 'Où est la boulangerie la plus proche?'}
translated_text = translator(question=text['sentence'], src_lang="French", tgt_lang="English")
print(f'Translation: {translated_text}.translated_text')

answer = image_qa(image=text['sentence'], question=translated_text)
audio_answer = transcriber(audio=answer)
print(f'Summary: {audio_answer}.summary')
print(f'Audio: {audio_answer}.audio.')

caption = 'La boulangerie la plus proche.'
text_to_speech(text_to_speech vlas=audio_answer)
audio_summary = text_to_speech(audio_to_sound(text=audio_answer))
print(f'Caption: {caption}.caption')
print(f'Audio: {audio_summary}.audio.')
====
Error in execution: The code generated by the agent is not valid.
invalid syntax. Perhaps you forgot a comma? (<unknown>, line 11). Be sure to provide correct code.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/transformers/agents/python_interpreter.py", line 886, in evaluate_python_code
    expression = ast.parse(code)
  File "/usr/lib/python3.10/ast.py", line 50, in parse
    return compile(source, filename, mode, flags,
  File "<unknown>", line 11
    text_to_speech(text_to_speech vlas=audio_answer)
                   ^^^^^^^^^^^^^^^^^^^
SyntaxError: invalid syntax. Perhaps you forgot a comma?

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/transformers/agents/agents.py", line 701, in run
    output = self.python_evaluator(
  File "/usr/local/lib/python3.10/dist-packages/transformers/agents/python_interpreter.py", line 888, in evaluate_python_code
    raise SyntaxError(f"The code generated by the agent is not valid.\n{e}")
SyntaxError: The code generated by the agent is not valid.
invalid syntax. Perhaps you forgot a comma? (<unknown>, line 11)
Error in execution: The code generated by the agent is not valid.\ninvalid syntax. Perhaps you forgot a comma? (<unknown>, line 11). Be sure to provide correct code.