The LLM is still in beta and efforts are concentrated on what the LLM can do and be used for. ChatGPT API on the other hand is available to developers and apps are appearing for use by individuals once a Key has been obtained. OpenAI parses AI input and output to consume purchased Tokens however, a fixed block of Tokens cannot be purchased as their business model requires unattended access to a credit card for either for debits or credits or to place a transaction lock on a purchase. This prevents cashcards from being used.
Individual use of the LLM and the purchase of session time needs consideration but its a bit of a chicken and egg situation with the egg arriving first. How much did it cost to feed the chicken?
An issue that OpenAI has yet to address in terms of consumable tokens is that consumer use of the their API will need a meter on the app to indicate the level of unit consumption and monetary cost something required by statutes globally. In other words consumption metrics.
As part of the beta program will Google offer an explanation to both developer and consumer of the LLM API apps as to how the purchase cost of LLM time and data will operate and be displayed to the user?
LinkedIn
Twitter
