Talk with Your Data: Application Development in the Era of LLM

LLMs are revolutionizing industries, but their real-world applications are still unfolding. As a researcher and developer, I'm at the forefront of this, creating an experimental cloud data analyst leveraging LLM technology. Our tool transform business queries into SQL or vector-based searches, extracting insights from our data lake, which houses Perth Crime Data, ABS 2021 Census Data, and school information. Results are presented visually or answered directly. Our demo at https://map.findperth.com/ showcases this. It features a GPT-4 backed analyst generating map reports and a chat feature for interactive queries about Perth Crime data. While promising, our prototype isn't market-ready. We're keen to share our development challenges and insights, aiming to spark discussions about the future of cloud application development.