Highlights
New Release for v0.1.1! We've made some significant updates! Previously known as AppAgent and ActAgent, we've rebranded them to HostAgent and AppAgent to better align with their functionalities. Explore the latest enhancements:
1. Learning from Human Demonstration: UFO now supports learning from human demonstration! Utilize the Windows Step Recorder to record your steps and demonstrate them for UFO. Refer to our detailed guide in README.md for more information.
2. Win32 Support: We've incorporated support for Win32 as a control backend, enhancing our UI automation capabilities.
3. Extended Application Interaction: UFO now goes beyond UI controls, allowing interaction with your application through keyboard inputs and native APIs! Presently, we support Word (examples), with more to come soon. Customize and build your own interactions.
4. Control Filtering: Streamline LLM's action process by using control filters to remove irrelevant control items. Enable them in config_dev.yaml under the control filtering section at the bottom.
What's Changed
- et_text enabled by @Lenny2Liu in #35
- price by @Mac0q in #42
- Enable human demonstration RAG by @yunhao0204 in #49
- Bump pillow from 10.2.0 to 10.3.0 by @dependabot in #52
- Vyokky/dev Agent and automator modularization + Learning for demonstration by @vyokky in #50
- update function name and add demo video in README by @yunhao0204 in #54
- hosted api by @Mac0q in #55
- enable win32 backend support by @yunhao0204 in #59
- Update README.md by @vyokky in #60
- control filter by @Mac0q in #61
- New openfileapp by @Lenny2Liu in #57
- fix filter by @Mac0q in #62
- Code refactor and control filtered by @vyokky in #63
- Minor fix for releasing new version by @vyokky in #67
- Dev/reformat by @vyokky in #69
- New release for v0.2.0 by @vyokky in #70
New Contributors
- @dependabot made their first contribution in #52
Full Changelog: v0.0.1...v0.2.0
What's Changed
- et_text enabled by @Lenny2Liu in #35
- price by @Mac0q in #42
- Enable human demonstration RAG by @yunhao0204 in #49
- Bump pillow from 10.2.0 to 10.3.0 by @dependabot in #52
- Vyokky/dev Agent and automator modularization + Learning for demonstration by @vyokky in #50
- update function name and add demo video in README by @yunhao0204 in #54
- hosted api by @Mac0q in #55
- enable win32 backend support by @yunhao0204 in #59
- Update README.md by @vyokky in #60
- control filter by @Mac0q in #61
- New openfileapp by @Lenny2Liu in #57
- fix filter by @Mac0q in #62
- Code refactor and control filtered by @vyokky in #63
- Minor fix for releasing new version by @vyokky in #67
- Dev/reformat by @vyokky in #69
- New release for v0.2.0 by @vyokky in #70
New Contributors
- @dependabot made their first contribution in #52
Full Changelog: v0.0.1...v0.1.1
