OthersideAI/self-operating-computer
1
0
Fork 0
mirror of https://github.com/OthersideAI/self-operating-computer.git synced 2026-03-30 16:17:02 +00:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 62fe6a9d06 update initialize_apis1 Josh Bickett 2024-01-15 10:03:45 -08:00
  • 6975d16725 fix validation bug Josh Bickett 2024-01-15 09:58:20 -08:00
  • de93bb4522 update name to config Josh Bickett 2024-01-15 09:46:47 -08:00
  • ec891c9af2 remove fetch_agent_1_response for now Josh Bickett 2024-01-15 07:47:44 -08:00
  • 0fed49d336 Merge pull request #134 from michaelhhogue/multiplatform-system-prompts Josh Bickett 2024-01-15 07:40:43 -08:00
  • 00720939fd Add multi-platform system prompts Michael Hogue 2024-01-14 13:10:47 -05:00
  • a071bb3a31 Remove Additional Thoughts now that hotkeys are added Josh Bickett 2024-01-14 07:45:31 -08:00
  • e5903232a8 Clean up README.md Josh Bickett 2024-01-14 07:44:32 -08:00
  • 0f54222e98 Update README.md Josh Bickett 2024-01-14 07:42:48 -08:00
  • 66043001d6 increase max_tokens Josh Bickett 2024-01-14 07:21:01 -08:00
  • cd8e6e3673 bump up max_tokens Josh Bickett 2024-01-14 07:12:44 -08:00
  • 9ce0aa11c5 fix call_gpt_4_vision_preview_labeled Josh Bickett 2024-01-14 06:57:06 -08:00
  • f0b606cf7b improve OPERATE_FIRST_MESSAGE_PROMPT and OPERATE_PROMPT Josh Bickett 2024-01-14 06:20:04 -08:00
  • c79b065211 Remove unused prompts, VISION_PROMPT, etc. Josh Bickett 2024-01-14 06:18:19 -08:00
  • 4aa05bcf64 update operate_type == "click" condition Josh Bickett 2024-01-14 06:13:03 -08:00
  • e15bbd69b1 Change mouse to click as it is clear what the purpose is Josh Bickett 2024-01-14 06:11:55 -08:00
  • e36d774d60 remove extra list dimension in call_gemini_pro_vision Josh Bickett 2024-01-14 06:05:56 -08:00
  • 76c28c9118 Update call_gemini_pro_vision to new method Josh Bickett 2024-01-14 06:03:14 -08:00
  • 182accee74 Remove img_base64_original from add_labels function Josh Bickett 2024-01-14 05:31:45 -08:00
  • 84742274d3 fix get_click_position_in_percent Josh Bickett 2024-01-14 05:21:01 -08:00
  • 42a8786616 remove format_label_prompt Josh Bickett 2024-01-14 05:16:29 -08:00
  • 6cd36fda4c Iterate call_gpt_4_vision_preview_labeled Josh Bickett 2024-01-14 05:16:12 -08:00
  • cee42ce7f4 Update to operating_system.py Josh Bickett 2024-01-13 07:04:09 -08:00
  • 3fddff3e7e Add better error handling for OperatingSystem Josh Bickett 2024-01-13 07:03:31 -08:00
  • 27c62840d4 Increase loop max Josh Bickett 2024-01-13 07:01:16 -08:00
  • b31c39cad4 Add config.verbose and better print Josh Bickett 2024-01-13 06:55:46 -08:00
  • 1444c1a0c0 Add missing __init__.py Josh Bickett 2024-01-13 06:41:47 -08:00
  • 35a0047be4 Remove monitor_size, no longer used Josh Bickett 2024-01-13 06:36:13 -08:00
  • 6624da5eab Update some file names, add get_user_prompt Josh Bickett 2024-01-13 06:33:41 -08:00
  • 196e091797 Add ANSI_BLUE Josh Bickett 2024-01-13 06:15:49 -08:00
  • e5df2b761b Add operation.get("summmary") Josh Bickett 2024-01-13 06:15:32 -08:00
  • 862e047996 name updates, operate(),etc. Josh Bickett 2024-01-13 06:10:37 -08:00
  • 6a1666c305 Update operating Josh Bickett 2024-01-13 06:07:10 -08:00
  • d19a376ed4 Create OperatingSystem class Josh Bickett 2024-01-12 16:00:34 -08:00
  • cab5912f61 SYSTEM_PROMPT updates Josh Bickett 2024-01-12 16:00:24 -08:00
  • b2a63dec95 Move get_last_assistant_message Josh Bickett 2024-01-12 15:18:13 -08:00
  • df002b4688 Fix convert_percent_to_decimal to match new prompt Josh Bickett 2024-01-12 15:16:51 -08:00
  • a204ca051d Update message_dialog Josh Bickett 2024-01-12 15:08:10 -08:00
  • 1068ab08c6 Remove add_grid_to_image Josh Bickett 2024-01-12 14:49:49 -08:00
  • 52d01c0f06 Remove add_grid_to_image approach Josh Bickett 2024-01-12 14:48:48 -08:00
  • 2291810faf Update execute_operations & remove search Josh Bickett 2024-01-12 14:44:57 -08:00
  • d5046791f3 Update call_gpt_4_v for keycommands Josh Bickett 2024-01-12 14:07:16 -08:00
  • 4e400016c8 Add SYSTEM_PROMPT Josh Bickett 2024-01-12 14:06:59 -08:00
  • 4e5168db3d Update README.md to temp version until updated Josh Bickett 2024-01-12 12:17:25 -08:00
  • 909efd7c52 better prints some fixes Josh Bickett 2024-01-12 11:00:07 -08:00
  • d0f47e6724 Add session_id for agent-1 api Josh Bickett 2024-01-12 10:54:21 -08:00
  • 6caa6a5dc4 remove capture_mini_screenshot_with_cursor, small iteration to new operate method Josh Bickett 2024-01-12 10:52:18 -08:00
  • c6d92c814e remove ACCURATE_MODE_VISION_PROMPT Josh Bickett 2024-01-12 09:34:11 -08:00
  • 6855df6861 Update to execute_operations1 Josh Bickett 2024-01-12 07:57:29 -08:00
  • ccf7edfdc7 Iterate execute_operations_new Josh Bickett 2024-01-12 07:36:13 -08:00
  • 48f17b1761 Fixes two bugs Josh Bickett 2024-01-11 14:37:38 -08:00
  • 639d3f64c2 Add back DECISION_PROMPT Josh Bickett 2024-01-11 11:44:52 -08:00
  • eecc0f7621 Create execute_operations function Josh Bickett 2024-01-11 07:48:17 -08:00
  • 578eb49610 Update version to "1.1.2" v1.1.2 Josh Bickett 2024-01-10 09:47:04 -08:00
  • 2d18de1e4c Fix prompt bug Josh Bickett 2024-01-10 09:14:34 -08:00
  • 215379f4d1 Merge pull request #129 from LeeKonyu/main Josh Bickett 2024-01-10 09:14:00 -08:00
  • 13c9dc838f Update prompts.py Kangyu Li 2024-01-10 11:19:27 +08:00
  • 35f85b4cd6 Update actions.py Kangyu Li 2024-01-10 11:18:50 +08:00
  • 3830598e0e Minor fixes and capture_screen_with_cursor Josh Bickett 2024-01-09 13:53:17 -08:00
  • 8f8787aa39 Remove async from fetch_agent_1_response Josh Bickett 2024-01-09 12:33:46 -08:00
  • 1edc76cde2 Add call_agent_1 Josh Bickett 2024-01-09 11:55:56 -08:00
  • 4a0a5dff19 Add call_agent_1 Josh Bickett 2024-01-09 08:59:40 -08:00
  • 631a52273a Add ### Set-of-Mark Prompting Josh Bickett 2024-01-07 10:21:23 -08:00
  • b7cbd842a8 Update to version="1.1.1" v1.1.1 Josh Bickett 2024-01-07 09:34:43 -08:00
  • 47778a31b8 Merge branch 'main' of https://github.com/OthersideAI/self-operating-computer Josh Bickett 2024-01-07 09:33:46 -08:00
  • d3d2ca498a Update version to 1.1.0 Josh Bickett 2024-01-07 09:33:44 -08:00
  • 23d9058e19 Merge pull request #125 from OthersideAI/SoM v1.1.0 Josh Bickett 2024-01-07 09:30:28 -08:00
  • fa05718adb Add fallback Something went wrong Josh Bickett 2024-01-07 09:25:25 -08:00
  • b2ae0ba391 Add new best.pt Josh Bickett 2024-01-07 09:25:02 -08:00
  • 44b0992aa1 Update yolo directory Josh Bickett 2024-01-07 09:05:39 -08:00
  • bc831f8dd4 Add YOLO("./model/weights/best.pt") Josh Bickett 2024-01-07 08:48:27 -08:00
  • 061746fe66 change name to keyboard_type Josh Bickett 2024-01-07 08:45:06 -08:00
  • e30726fe70 Update to os.py and Josh Bickett 2024-01-07 08:44:04 -08:00
  • 075e365baa More file name updates Josh Bickett 2024-01-07 07:44:25 -08:00
  • ecc39a05b1 Add best.pt yolo weights Josh Bickett 2024-01-07 07:25:16 -08:00
  • 0b1981b318 Remove unnecessary folder structure Josh Bickett 2024-01-07 07:15:16 -08:00
  • b013002a3f Delete prompt_util.py Josh Bickett 2024-01-07 07:08:09 -08:00
  • 0d92682593 Adjust file names Josh Bickett 2024-01-07 07:06:52 -08:00
  • eebabeb924 Change naming from predictions to detections Josh Bickett 2024-01-06 07:17:45 -08:00
  • 3fcb7e13d5 Fix dict issue for call_gpt_4_v_labeled Josh Bickett 2024-01-05 16:03:46 -08:00
  • 61584a6922 Add gpt-4-with-som model option Josh Bickett 2024-01-05 08:00:25 -08:00
  • 05a4733db1 Update .gitignore Josh Bickett 2024-01-05 07:55:54 -08:00
  • 67c97e5109 Update requirements.txt Josh Bickett 2024-01-05 07:05:33 -08:00
  • a1670082cb add aiohttp Josh Bickett 2024-01-04 18:51:46 -08:00
  • 111b5f8f33 Add call_gpt_4_v_labeled for set of mark prompting Josh Bickett 2024-01-04 18:46:25 -08:00
  • 76467fc35c Add parse_click_content to labeling.py Josh Bickett 2024-01-04 18:42:28 -08:00
  • 4f7ca64497 Update function names call_gpt_4_v, etc. Josh Bickett 2024-01-04 17:02:46 -08:00
  • af47ea025b Update file name to actions.py until we think of something better Josh Bickett 2024-01-04 16:58:09 -08:00
  • 2a72434d85 Add prompt function format_decision_prompt, etc. Josh Bickett 2024-01-04 07:49:11 -08:00
  • e98df7a754 update ansi_colors.py to styles.py, and other small changes Josh Bickett 2024-01-04 07:42:05 -08:00
  • a2e7194094 Rename prompt.py to prompts.py Josh Bickett 2024-01-04 07:36:13 -08:00
  • 511c9187c5 Move prompt functions to prompt.py Josh Bickett 2024-01-04 07:35:31 -08:00
  • 73d59a7414 Add labeling.py Josh Bickett 2024-01-04 07:33:02 -08:00
  • 3b4b9c4530 Add DECISION_PROMPT and LABELED_IMAGE_PROMPT Josh Bickett 2024-01-03 20:16:35 -08:00
  • ecb6419c64 Remove -accurate mode until fixed Josh Bickett 2024-01-03 20:02:23 -08:00
  • 8bd5d76cb2 Merge pull request #121 from Yash-1511/issuetemplates Josh Bickett 2024-01-02 06:46:13 -08:00
  • 764ac77e93 ADD: Issue templates added(pull request,bug,feature request).issue #120 Yash_1124 2024-01-01 23:42:45 +05:30
  • 55b1053eaf Update version="1.0.9" v1.0.9 Josh Bickett 2023-12-30 11:33:24 -08:00
  • 2a5b598429 Improve VISION_PROMPT Josh Bickett 2023-12-30 11:33:10 -08:00
  • 0e0a296c74 Merge pull request #119 from gtlYashParmar/refactor Josh Bickett 2023-12-30 09:32:23 -08:00