update vertexai and google multimodal inputting

examples/gemini/data/output/gemini-example/18-10-2024-09-57-29-completed-gemini-example.jsonl

@@ -0,0 +1,6 @@
+{"id": 0, "api": "gemini", "model_name": "gemini-1.5-flash", "prompt": "How does technology impact us?", "safety_filter": "none", "parameters": {"candidate_count": 1, "temperature": 1, "max_output_tokens": 100}, "timestamp_sent": "18-10-2024-09-57-31", "response": "Technology impacts us in profound and multifaceted ways, shaping our lives in every aspect from communication and work to entertainment and healthcare. Here's a breakdown of key impacts:\n\n**Positive Impacts:**\n\n* **Enhanced Communication:** Technology has revolutionized communication. We can connect with people across the globe instantly through video calls, instant messaging, and social media. This fosters stronger relationships, facilitates business, and enables global collaboration.\n* **Increased Efficiency and Productivity:** Technology automates tasks, streamlines processes,", "safety_attributes": {"HARM_CATEGORY_SEXUALLY_EXPLICIT": "1", "HARM_CATEGORY_HATE_SPEECH": "1", "HARM_CATEGORY_HARASSMENT": "1", "HARM_CATEGORY_DANGEROUS_CONTENT": "1", "blocked": "[False, False, False, False]", "finish_reason": "MAX_TOKENS"}}
+{"id": 1, "api": "gemini", "model_name": "gemini-1.0-pro", "prompt": "How does technology impact us?", "safety_filter": "few", "parameters": {"candidate_count": 1, "temperature": 1, "max_output_tokens": 100}, "timestamp_sent": "18-10-2024-09-57-33", "response": "**Positive Impacts of Technology**\n\n* **Enhanced Communication:** Social media, messaging apps, and video conferencing facilitate seamless connection and information exchange globally.\n* **Increased Accessibility:** Technology provides equal access to education, healthcare, and information for individuals regardless of location or circumstances.\n* **Improved Productivity:** Automation, artificial intelligence, and data analytics streamline processes, improve efficiency, and reduce time consumption.\n* **Medical Advancements:** Medical devices, surgical robots, and telemedicine enhance patient care, improve", "safety_attributes": {"HARM_CATEGORY_SEXUALLY_EXPLICIT": "1", "HARM_CATEGORY_HATE_SPEECH": "1", "HARM_CATEGORY_HARASSMENT": "1", "HARM_CATEGORY_DANGEROUS_CONTENT": "1", "blocked": "[False, False, False, False]", "finish_reason": "MAX_TOKENS"}}
+{"id": 2, "api": "gemini", "model_name": "gemini-1.5-flash", "prompt": ["How does international trade create jobs?", "I want a joke about that"], "safety_filter": "some", "parameters": {"candidate_count": 1, "temperature": 1, "max_output_tokens": 100}, "timestamp_sent": "18-10-2024-09-57-35", "response": ["International trade creates jobs in a multitude of ways, boosting both domestic and global economies. Here's a breakdown of how it works:\n\n**1. Increased Production and Export Jobs:**\n\n* **Specialization and Comparative Advantage:** Countries specialize in producing goods and services where they have a comparative advantage (lower opportunity cost). This leads to increased efficiency and higher production levels.\n* **Export Jobs:**  Producers of these specialized goods and services find new markets abroad, leading to increased demand for their products", "Why did the economist get a job in international trade?\n\nBecause he was tired of being a \"jobless\" economist! \ud83d\ude1c \n"], "safety_attributes": [{"HARM_CATEGORY_SEXUALLY_EXPLICIT": "1", "HARM_CATEGORY_HATE_SPEECH": "1", "HARM_CATEGORY_HARASSMENT": "1", "HARM_CATEGORY_DANGEROUS_CONTENT": "1", "blocked": "[False, False, False, False]", "finish_reason": "MAX_TOKENS"}, {"HARM_CATEGORY_SEXUALLY_EXPLICIT": "1", "HARM_CATEGORY_HATE_SPEECH": "1", "HARM_CATEGORY_HARASSMENT": "2", "HARM_CATEGORY_DANGEROUS_CONTENT": "1", "blocked": "[False, False, False, False]", "finish_reason": "STOP"}]}
+{"id": 3, "api": "gemini", "model_name": "gemini-1.5-flash", "prompt": [{"role": "system", "parts": "You are a helpful assistant designed to answer questions briefly."}, {"role": "user", "parts": "What efforts are being made to keep the hakka language alive?"}], "safety_filter": "default", "parameters": {"candidate_count": 1, "temperature": 1, "max_output_tokens": 100}, "timestamp_sent": "18-10-2024-09-57-37", "response": "Efforts to preserve Hakka include language schools, cultural festivals, and online resources. \n", "safety_attributes": {"HARM_CATEGORY_SEXUALLY_EXPLICIT": "1", "HARM_CATEGORY_HATE_SPEECH": "1", "HARM_CATEGORY_HARASSMENT": "1", "HARM_CATEGORY_DANGEROUS_CONTENT": "1", "blocked": "[False, False, False, False]", "finish_reason": "STOP"}}
+{"id": 4, "api": "gemini", "model_name": "gemini-1.5-flash", "prompt": [{"role": "user", "parts": "What efforts are being made to keep the hakka language alive?"}, {"role": "system", "parts": "You are a helpful assistant designed to answer questions briefly."}], "safety_filter": "most", "parameters": {"candidate_count": 1, "temperature": 1, "max_output_tokens": 100}, "timestamp_sent": "18-10-2024-09-57-39", "response": "TypeError - if api == 'gemini', then the prompt must be a str, list[str], or list[dict[str,str]] where the dictionary contains the keys 'role' and 'parts' only, and the values for 'role' must be one of 'user' or 'model', except for the first message in the list of dictionaries can be a system message with the key 'role' set to 'system'."}
+{"id": 5, "api": "gemini", "model_name": "gemini-1.5-flash", "prompt": [{"role": "system", "parts": "You are a helpful assistant designed to answer questions briefly."}, {"role": "user", "parts": "Hello, I'm Bob and I'm 6 years old"}, {"role": "model", "parts": "Hi Bob, how may I assist you?"}, {"role": "user", "parts": "How old will I be next year?"}], "safety_filter": "most", "parameters": {"candidate_count": 1, "temperature": 1, "max_output_tokens": 100}, "timestamp_sent": "18-10-2024-09-57-41", "response": "You will be 7 years old next year! \n", "safety_attributes": {"HARM_CATEGORY_SEXUALLY_EXPLICIT": "1", "HARM_CATEGORY_HATE_SPEECH": "1", "HARM_CATEGORY_HARASSMENT": "1", "HARM_CATEGORY_DANGEROUS_CONTENT": "1", "blocked": "[False, False, False, False]", "finish_reason": "STOP"}}

examples/gemini/data/output/gemini-example/18-10-2024-09-57-29-log-gemini-example.txt

@@ -0,0 +1,2 @@
+18-10-2024, 09:57: Error (i=5, id=4): TypeError - if api == 'gemini', then the prompt must be a str, list[str], or list[dict[str,str]] where the dictionary contains the keys 'role' and 'parts' only, and the values for 'role' must be one of 'user' or 'model', except for the first message in the list of dictionaries can be a system message with the key 'role' set to 'system'.
+18-10-2024, 09:57: Completed experiment: gemini-example.jsonl! Experiment processing time: 12.673 seconds, Average time per query: 2.112 seconds