Row 60014

Row ID: 60014 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 60014 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Based on my own testing, I don't think trying to provide a single pdf with a bunch of images (or combining a bunch of images into a single screenshot) - would work very well. At least in my case, gpt-4o struggled to discriminate between images in the same pdf - and often gave back answers that made it seem like it was blending the images together (this was a fairly simple pdf with only 2 images).

The openai cookbook for gpt-4o shows how to prompt for a specific image url (each image on a website will generally have its own unique url). So, you'd just need a method of identifying each image url on a web page (I'm sure chat-gpt could help you with this), and then feed each of those urls into the api code shown in the cookbook demo.

[https://cookbook.openai.com/examples/gpt4o/introduction\_to\_gpt4o#url-image-processing](https://cookbook.openai.com/examples/gpt4o/introduction_to_gpt4o#url-image-processing)

If you don't want to use the api, it might also be possible to set something like this up using custom GPTs with actions or function calling. I wouldn't be surprised if someone else had already created a custom gpt to do something like this, since it seems like a pretty useful task.

Possibly also relevant:

[https://github.com/mishushakov/llm-scraper/](https://github.com/mishushakov/llm-scraper/)

[https://github.com/OSU-NLP-Group/SeeAct](https://github.com/OSU-NLP-Group/SeeAct)

FieldValue
text Based on my own testing, I don't think trying to provide a single pdf with a bunch of images (or combining a bunch of images into a single screenshot) - would work very well. At least in my case, gpt-4o struggled to discriminate between images in the same pdf - and often gave back answers that made it seem like it was blending the images together (this was a fairly simple pdf with only 2 images). The openai cookbook for gpt-4o shows how to prompt for a specific image url (each image on a websit…
label r/openai
dataType comment
communityName r/OpenAI
datetime 2024-05-23
username_encoded Z0FBQUFBQm5Lak1ZRzVKME45NWJmSXRGbGhOUmdrelItWEF5WlpwNWdLU1dQM2pXemJHam9ydDlvNmNoV2Y0QzNFenN6VWN0WjMzZ0YzTjJjVmwxb2pqYU1yUUJ4SmtqalYzMnZqTE04TkYtX1FSeV80bm5CUFk9
url_encoded Z0FBQUFBQm5Lak9vVzdiS294Q1Y2LS0wZVhId1hMSndUYXUzb292eEhmVUlJR2JYQ2ZYUTJEMTNDMFUtUVNmRmhveE03NUhBakNmbzVlTElXV1RIYkdKRjkzZHphdmhCcjRXdUk1SnhNcWs0QlZHLVplOFEwa3ZnbG5lR1c3LW9DenE5cUN2d3JBN0l2cjBRUGVNMEk2Y20ySURFdjFhdDEwak9XYmZIOFp6LUdGcFRoTjhZYzFWTG9Ba3FxR0JMM3VVLVN4dHNIck1qa1p2aDZyS2ZmU0xKdl95WTFqaVZwdz09

Raw Record

{
  "text": "Based on my own testing, I don't think trying to provide a single pdf with a bunch of images (or combining a bunch of images into a single screenshot) - would work very well. At least in my case, gpt-4o struggled to discriminate between images in the same pdf - and often gave back answers that made it seem like it was blending the images together (this was a fairly simple pdf with only 2 images).\n\nThe openai cookbook for gpt-4o shows how to prompt for a specific image url (each image on a website will generally have its own unique url). So, you'd just need a method of identifying each image url on a web page (I'm sure chat-gpt could help you with this), and then feed each of those urls into the api code shown in the cookbook demo.\n\n[https://cookbook.openai.com/examples/gpt4o/introduction\\_to\\_gpt4o#url-image-processing](https://cookbook.openai.com/examples/gpt4o/introduction_to_gpt4o#url-image-processing)\n\nIf you don't want to use the api, it might also be possible to set something like this up using custom GPTs with actions or function calling.  I wouldn't be surprised if someone else had already created a custom gpt to do something like this, since it seems like a pretty useful task.\n\nPossibly also relevant:\n\n[https://github.com/mishushakov/llm-scraper/](https://github.com/mishushakov/llm-scraper/)\n\n[https://github.com/OSU-NLP-Group/SeeAct](https://github.com/OSU-NLP-Group/SeeAct)",
  "label": "r/openai",
  "dataType": "comment",
  "communityName": "r/OpenAI",
  "datetime": "2024-05-23",
  "username_encoded": "Z0FBQUFBQm5Lak1ZRzVKME45NWJmSXRGbGhOUmdrelItWEF5WlpwNWdLU1dQM2pXemJHam9ydDlvNmNoV2Y0QzNFenN6VWN0WjMzZ0YzTjJjVmwxb2pqYU1yUUJ4SmtqalYzMnZqTE04TkYtX1FSeV80bm5CUFk9",
  "url_encoded": "Z0FBQUFBQm5Lak9vVzdiS294Q1Y2LS0wZVhId1hMSndUYXUzb292eEhmVUlJR2JYQ2ZYUTJEMTNDMFUtUVNmRmhveE03NUhBakNmbzVlTElXV1RIYkdKRjkzZHphdmhCcjRXdUk1SnhNcWs0QlZHLVplOFEwa3ZnbG5lR1c3LW9DenE5cUN2d3JBN0l2cjBRUGVNMEk2Y20ySURFdjFhdDEwak9XYmZIOFp6LUdGcFRoTjhZYzFWTG9Ba3FxR0JMM3VVLVN4dHNIck1qa1p2aDZyS2ZmU0xKdl95WTFqaVZwdz09"
}
Explore Dataset Explore Row

Entry Information