You can go here to get an over view, of why I choose to make this app.
“What Flower” uses one of Apple’s newest features for it’s iOS platform, CoreML. CoreML comes in two parts, the actual feature on your phone, and the open source library that is provided by Apple 😮. Yes I know that is really surprising considering how locked down Apple is about their products.
Now the TLDR version of what the CoreML feature is simply a framework that lets you utilize pre trained neutral networks in your iOS apps. That is done by using a widely recognized model format known as “.ml”. Now Apple knows that not everyone is going to have models that come in that format, so they also made a open source python library that converts other model formats into the “.ml” format.
“What Flower” uses a number of different per-trained models that are made to identify different types of flowers. It does this by running a few models and figuring out how which one is most likely to be correct. One of the models it will be running is the “oxford102” that you can find here.
Another feature of this app is that it lets you keep track of the different flowers you have seen, and have yet to see. Turning the process of identifying flowers into a scavenger hunt, or a much simpler version of Pokemon Go. Hmmm… Maybe get badges for each new flower you see ???
Its still in the idea stages and have been doing some UI sketches. Well update you when I have something more concrete.