Google introduced multisearch. This helps you to search using image and the text at the same time.for example you can snap a plant and ask for its care instructions using text. currrently this facility is available as beta in U.S.
https://blog.google/products/search/multisearch/