What Is Kong?
Kong is a gamified plant identification app powered by OpenAI and StabilityAI which aims to foster a love towards nature in a fun and artistic way. When user uploads or takes a photo of a plant, the app identifies the plant and generates a Pokémon-like illustration. The content is then added to the user's collection.
Why is Kong necessary?
According to the World Economic Forum, almost 8 out of 10 children do not recognize common plants like an oak leaf or a bluebell. In a world where climate crisis is worse than ever, it is essential that we don't forget about the very basics: fostering a culture where we love and appreciate nature and have empathy towards the environment.
Tech Stack
- React
- Express
- MySQL
- OpenAI API
- StabilityAI API
How does it work?
- User takes or uploads photo of a plant
- MyPlantnet API identifies the plant
- OpenAI API generates the plant data
- StabilityAI API creates the illustration
- User can read, update, or delete plant data
Key Learnings
- How to write efficient and effective prompts for OpenAI API and StableAI API
- Know when to change course of the project
- Sticking with the planned deliverable and creating a solid MVP
- Importance of a good night's sleep
Next Steps
- Create login so each user would have access to their own plant collection
- Incorporate Comfy UI for fine-tuned image generation
- Tutorial on initial start to show how app works
- Ability to send multiple photos to API for better identification
- Google Maps integration to visually represent plant's habitat
- Featured Plants page to show nearby plants that can be added to the collection