You have to deploy the tuned model to an endpoint (it will be running 24/7) and then can use the following Python code:
import vertexai
import os
os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = '/home/user/key.json'
import vertexai
from google.cloud.aiplatform.private_preview.language_models import TextGenerationModel
vertexai.init(project="your-project", location="us-central1")
parameters = {
"temperature": 0.2,
"max_output_tokens": 256,
"top_p": 0.8,
"top_k": 40
}
model = TextGenerationModel.get_tuned_model("fine-tuned-model-name-here")
from flask import Flask, request, jsonify
app = Flask(__name__)
import json
from collections import Counter
@app.route('/predict', methods= ['POST'])
def predict():
if request.get_json():
x=json.dumps(request.get_json())
x=json.loads(x)
else:
x={}
data=x["text"] # text
print(data)
response = model.predict("""input: I had to compare two versions of Hamlet for my Shakespeare class and unfortunately I picked this version. Everything from the acting (the actors deliver most of their lines directly to the camera) to the camera shots (all medium or close up shots...no scenery shots and very little back ground in the shots) were absolutely terrible. I watched this over my spring break and it is very safe to say that I feel that I was gypped out of 114 minutes of my vacation. Not recommended by any stretch of the imagination.
Classify the sentiment of the message: negative
input: This Charles outing is decent but this is a pretty low-key performance. Marlon Brando stands out. There\'s a subplot with Mira Sorvino and Donald Sutherland that forgets to develop and it hurts the film a little. I\'m still trying to figure out why Charlie want to change his name.
Classify the sentiment of the message: negative
input: My family has watched Arthur Bach stumble and stammer since the movie first came out. We have most lines memorized. I watched it two weeks ago and still get tickled at the simple humor and view-at-life that Dudley Moore portrays. Liza Minelli did a wonderful job as the side kick - though I\'m not her biggest fan. This movie makes me just enjoy watching movies. My favorite scene is when Arthur is visiting his fiancée\'s house. His conversation with the butler and Susan\'s father is side-spitting. The line from the butler, \"Would you care to wait in the Library\" followed by Arthur\'s reply, \"Yes I would, the bathroom is out of the question\", is my NEWMAIL notification on my computer.
Classify the sentiment of the message: positive
input: {}
Classify the sentiment of the message:
""".format(data),**parameters)
response=jsonify(response.text)
print(response)
return response
if __name__ == "__main__":
app.run(port=8080, host='0.0.0.0', debug=True)
LinkedIn
Twitter
