self-operating-computer

OthersideAI/self-operating-computer

Fork 0

mirror of https://github.com/OthersideAI/self-operating-computer.git synced 2026-03-30 16:17:02 +00:00

Commit Graph

Select branches

Hide Pull Requests

add-agent-1

add-ocr

dev

gpt-4-turbo

gpt-4o

main

refactor

#1

#10

#100

#105

#107

#108

#11

#110

#111

#112

#113

#114

#119

#121

#125

#126

#126

#129

#13

#134

#135

#136

#141

#143

#144

#145

#152

#154

#154

#157

#157

#16

#161

#162

#163

#172

#180

#185

#188

#19

#191

#191

#192

#192

#206

#224

#224

#226

#226

#227

#227

#229

#229

#230

#232

#232

#233

#236

#236

#237

#237

#238

#239

#241

#242

#247

#247

#249

#249

#250

#250

#252

#252

#255

#255

#256

#256

#257

#257

#258

#258

#260

#260

#264

#264

#265

#265

#268

#28

#34

#40

#41

#43

#44

#45

#47

#48

#49

#50

#51

#52

#54

#55

#57

#59

#61

#62

#63

#68

#70

#71

#75

#76

#8

#81

#82

#83

#89

#91

#96

#97

#97

#98

1.0.4

v1.0.1

v1.0.2

v1.0.3

v1.0.5

v1.0.6

v1.0.7

v1.0.8

v1.0.9

v1.1.0

v1.1.1

v1.1.2

v1.2.0

v1.2.1

v1.2.2

v1.2.3

v1.2.4

v1.2.5

v1.2.6

v1.2.7

v1.2.8

v1.2.9

v1.3.0

v1.3.1

v1.3.2

v1.4.0

v1.4.1

v1.4.2

v1.4.5

v1.4.6

v1.5.0

v1.5.1

v1.5.5

v1.5.6

v1.5.7

v1.5.8

32a42418e5 Improve VISION_PROMPT Josh Bickett 2023-11-21 09:36:02 -08:00
4958751b87 Trying ## Demo again Josh Bickett 2023-11-20 11:29:11 -08:00
8d7ccfe95a Improve VISION_PROMPT Josh Bickett 2023-11-20 07:23:08 -08:00
25802aebc9 Improve VISION_PROMPT Josh Bickett 2023-11-20 07:11:37 -08:00
d5215e83b2 Improve VISION_PROMPT and messaging Josh Bickett 2023-11-19 19:45:57 -08:00
3dc9c28bdd VISION_PROMPT improvements Josh Bickett 2023-11-19 19:37:29 -08:00
e95216edb7 VISION_PROMPT needs some help for chrome Josh Bickett 2023-11-19 14:33:19 -08:00
5240bc5789 remove demo.mov for now Josh Bickett 2023-11-18 16:53:07 -08:00
bb3d503375 Add [Video Demo] to README.md Josh Bickett 2023-11-18 16:44:20 -08:00
57dd8f7aee update VISION_PROMPT Josh Bickett 2023-11-18 08:42:00 -08:00
4f54478fd2 Trying a new VERY IMPORTANT Josh Bickett 2023-11-18 08:20:49 -08:00
a9a8c4799f Only print if action_type != "UNKNOWN" Josh Bickett 2023-11-18 08:18:13 -08:00
1df96fcba7 Adding DO NOT REFUSE TO OPERATE THE COMPUTER. because oai keeps refusing Josh Bickett 2023-11-18 08:14:34 -08:00
dd30d62fc4 Update error prints Josh Bickett 2023-11-18 08:10:00 -08:00
bdb4d0994b Add else handling for unknown response Josh Bickett 2023-11-18 08:08:25 -08:00
e0267fff6e Improve VISION_PROMPT because gpt thinks it can't do things Josh Bickett 2023-11-18 08:01:47 -08:00
b708b59ca6 Update setup.py and main.py to include main_entry Josh Bickett 2023-11-18 06:48:09 -08:00
42e5b2dca8 Add multiple model compatibility and ModelNotRecognizedException Josh Bickett 2023-11-17 22:37:39 -08:00
579b51e15e Add argparse Josh Bickett 2023-11-17 21:30:14 -08:00
2cdb4ae6c2 Improve ### Contributions are Welcomed! Some Ideas: Josh Bickett 2023-11-17 19:40:37 -08:00
59277be935 remove unnecessary print Josh Bickett 2023-11-17 19:19:51 -08:00
bb31466ca4 Update SUMMARY_PROMPT further Josh Bickett 2023-11-17 19:12:28 -08:00
c46ca725e7 improve SUMMARY_PROMPT further Josh Bickett 2023-11-17 19:11:08 -08:00
fe0d8821b6 Improve SUMMARY_PROMPT Josh Bickett 2023-11-17 19:05:18 -08:00
6a5c0b4a7b Update summarize Josh Bickett 2023-11-17 14:15:24 -08:00
d70ab48ba8 Update summarize function Josh Bickett 2023-11-17 14:15:06 -08:00
dcf31c091e Always press enter after keyboard_type Josh Bickett 2023-11-17 13:33:56 -08:00
947c4852aa Add ## Demo placeholder Josh Bickett 2023-11-17 13:30:41 -08:00
82dc6ca2d1 More README.md updates Josh Bickett 2023-11-17 13:08:26 -08:00
d13598ce63 Center title in README.md Josh Bickett 2023-11-17 12:58:20 -08:00
1990b9d244 remove unnecessary parameter for format_summary_prompt Josh Bickett 2023-11-17 12:57:09 -08:00
b4a07c05f2 Add new png to README.md Josh Bickett 2023-11-17 12:56:34 -08:00
d885056e0c Add new png Josh Bickett 2023-11-17 12:55:34 -08:00
e56a585017 More README.md updates Josh Bickett 2023-11-17 12:46:01 -08:00
12ecc57945 align images in readme.md center Josh Bickett 2023-11-17 12:37:47 -08:00
5306d17e3e I trusted chatgpt too much Josh Bickett 2023-11-17 11:34:34 -08:00
fa90ba4db2 Wow you can do all kinds of crazy stuff in README.mds Josh Bickett 2023-11-17 11:33:40 -08:00
199d16e139 Oh cool, it works. Make images smaller in README.md Josh Bickett 2023-11-17 11:32:38 -08:00
9939ad2aa1 I guess this works? Josh Bickett 2023-11-17 11:32:14 -08:00
eac1305eb1 More README.md updates Josh Bickett 2023-11-17 11:30:21 -08:00
cc382e85cc Add README.md tutorial screenshots Josh Bickett 2023-11-17 11:27:44 -08:00
8abb1f53f5 Another README.md step Josh Bickett 2023-11-17 11:16:24 -08:00
24f47b7dc5 Update README.md with openai step Josh Bickett 2023-11-17 11:15:15 -08:00
91a631077f Add .example.env for README.md setup Josh Bickett 2023-11-17 11:13:26 -08:00
96a7ea37f5 remove unnecessary else Josh Bickett 2023-11-17 11:00:45 -08:00
33b8504e32 Remove unused vars tools, etc. Josh Bickett 2023-11-17 10:59:25 -08:00
57bbd143cd import cleanup Josh Bickett 2023-11-17 10:53:45 -08:00
0f37b631d2 Add print, improve prompt, remove old code Josh Bickett 2023-11-17 10:45:01 -08:00
d14c9cbe0c Improve VISION_PROMPT and prints Josh Bickett 2023-11-17 10:35:40 -08:00
bab7cbb7a2 Update prints and add break when done Josh Bickett 2023-11-17 10:16:09 -08:00
85138904f0 Update framework prints and delete old code Josh Bickett 2023-11-17 10:06:09 -08:00
13cdffe8c0 Improve VISION_PROMPT and remove SYSTEM_PROMPT Josh Bickett 2023-11-17 10:01:13 -08:00
ced164865b improve VISION_PROMPT Josh Bickett 2023-11-17 09:08:43 -08:00
882f51b0cd Update mouse_click Josh Bickett 2023-11-17 08:40:11 -08:00
f272dc98df Maybe gpt-4v doesn't play well with SYSTEM_PROMPT Josh Bickett 2023-11-17 08:27:01 -08:00
d9237cab5d Reinforce done state Josh Bickett 2023-11-17 08:23:03 -08:00
f828d70382 Create screenshots_dir if it doesn't exist Josh Bickett 2023-11-17 08:14:48 -08:00
634002b67d Remove WITH_REFLECTION Josh Bickett 2023-11-17 08:12:12 -08:00
fc96b94f48 Merge branch 'rewrite' of https://github.com/OthersideAI/self-driving-computer into rewrite Josh Bickett 2023-11-17 08:07:18 -08:00
16495f5884 Bug fix, thanks Matt for finding Josh Bickett 2023-11-17 08:07:16 -08:00
f8b5e9caf6 fix small bug mshumer 2023-11-17 11:06:48 -05:00
dfedf2808c Improve main loop Josh Bickett 2023-11-17 08:04:04 -08:00
31b7c0362d Add parse_oai_response and other minor changes Josh Bickett 2023-11-17 07:35:51 -08:00
97037dbff6 Create new VISION_PROMPT approach Josh Bickett 2023-11-17 07:14:37 -08:00
7c6dd0f7d0 more print changes Josh Bickett 2023-11-16 19:32:35 -08:00
a88e7d492c Remove click_instruction Josh Bickett 2023-11-16 19:32:00 -08:00
1c54499c9e Try without WITH_REFLECTION Josh Bickett 2023-11-16 19:28:09 -08:00
88dbbde87d Remove unnecessary spaces from prints Josh Bickett 2023-11-16 19:22:38 -08:00
66ff31c2b3 Fix wrap Josh Bickett 2023-11-16 10:17:06 -08:00
9c689f7b03 prompt adjustments Josh Bickett 2023-11-16 10:04:48 -08:00
851049abbc Add summarize function Josh Bickett 2023-11-15 17:31:58 -08:00
37a6d7afe1 update .gitignore Josh Bickett 2023-11-15 17:31:47 -08:00
57709228c1 Improve format_mouse_prompt Josh Bickett 2023-11-15 17:12:37 -08:00
337edac152 REFLECTION_PROMPT improvements and turn off debugging Josh Bickett 2023-11-15 16:57:54 -08:00
20bbce5035 Improve REFLECTION_PROMPT Josh Bickett 2023-11-15 16:27:29 -08:00
210ce489d8 readme.md updates Josh Bickett 2023-11-15 16:00:24 -08:00
66e549dd4a improve add_grid_to_image Josh Bickett 2023-11-15 11:22:12 -08:00
f6ca26d8f2 Add reflect Josh Bickett 2023-11-15 11:01:42 -08:00
21eec1905b Update .gitignore for screenshots Josh Bickett 2023-11-15 10:55:52 -08:00
06b4347d43 Add ### Additional Thoughts Josh Bickett 2023-11-15 10:47:05 -08:00
db632b216a changes to add_grid_to_image, etc. Josh Bickett 2023-11-14 22:58:30 -08:00
fc8853771b Minor prompt and USER_QUESTION improvements Josh Bickett 2023-11-14 22:47:01 -08:00
9f81238986 Remove USER_TOOL_PROMPT Josh Bickett 2023-11-14 22:37:52 -08:00
79d71ccca4 more read me improvements Josh Bickett 2023-11-14 19:40:54 -08:00
276930c668 Improve ### Instructions Josh Bickett 2023-11-14 19:36:44 -08:00
3561b95d91 Make README.md prettier Josh Bickett 2023-11-14 19:25:29 -08:00
a85a6b4c22 Update README.md intro Josh Bickett 2023-11-14 19:22:38 -08:00
3e92b9ff8f More pretty prints Josh Bickett 2023-11-14 14:45:15 -08:00
8e78515e07 Oops, Falsee..... Josh Bickett 2023-11-14 14:38:47 -08:00
0b07e30fa9 Update README.md Josh Bickett 2023-11-14 14:36:28 -08:00
73113f8072 Update prompts and add ANSI_BLUE Josh Bickett 2023-11-14 14:26:00 -08:00
ceef1cb522 Fix undefined var bug Josh Bickett 2023-11-14 14:14:51 -08:00
20762cf0d7 update README.md Josh Bickett 2023-11-14 14:07:21 -08:00
3e19ed941f Add setup.py for streamline setup Josh Bickett 2023-11-14 14:01:37 -08:00
ddd72cff2a Improve styles and prompts Josh Bickett 2023-11-14 13:02:41 -08:00
68a0fa52b8 Add more styles Josh Bickett 2023-11-14 09:05:39 -08:00
a6ab16d628 Remove unused TYPE_PROMPT Josh Bickett 2023-11-13 19:20:54 -08:00
d81fd60dcf Improve MOUSE_PROMPT Josh Bickett 2023-11-13 11:25:55 -08:00
287a7dc14f Improve prompt & prints Josh Bickett 2023-11-13 11:09:25 -08:00
e419cca1fb remove .sleep and improve MOUSE_PROMPT Josh Bickett 2023-11-13 10:56:25 -08:00

... 4 5 6 7 8 ...