Welcome to the pix2pix-zero-directions repository! Here, you will find edit directions for 100 additional classes for the paper "Zero-shot Image-to-Image Translation," also known as pix2pix-zero. Additionally, we have included code on how to generate these directions using GPT-3.5.
⚠️ You need OpenAI's API key if you want to generate your own texts. If you just want to use the embedding for the 100 classes provided in this repo, you dont require it.
- Run
main.pyto generate 1000 sentences per class. We have designed the code to be robust to OpenAI's API failures. You can adjust the number of generated sentences per class using the count parameter. - Use
clean_generated_text.pyto remove any garbage sentences from the generated text. - Run
gen_direction.pyto generate the direction for each class using the cleaned sentences found in thecleaned_gendirectory. The directions are saved in theembeddingsdirectory. This script also generates100_class_dict.pt, which contains the directions in a convenient dict format. - Use
embeddingsfolder if you just want to access the embeddings for 100 provided classes.
We have provided a list of available classes below, which includes 100 classes (CIFAR100) in total.
fine_labels = [
'apple', # id 0
'aquarium_fish',
'baby',
'bear',
'beaver',
'bed',
'bee',
'beetle',
'bicycle',
'bottle',
'bowl',
'boy',
'bridge',
'bus',
'butterfly',
'camel',
'can',
'castle',
'caterpillar',
'cattle',
'chair',
'chimpanzee',
'clock',
'cloud',
'cockroach',
'couch',
'crab',
'crocodile',
'cup',
'dinosaur',
'dolphin',
'elephant',
'flatfish',
'forest',
'fox',
'girl',
'hamster',
'house',
'kangaroo',
'computer_keyboard',
'lamp',
'lawn_mower',
'leopard',
'lion',
'lizard',
'lobster',
'man',
'maple_tree',
'motorcycle',
'mountain',
'mouse',
'mushroom',
'oak_tree',
'orange',
'orchid',
'otter',
'palm_tree',
'pear',
'pickup_truck',
'pine_tree',
'plain',
'plate',
'poppy',
'porcupine',
'possum',
'rabbit',
'raccoon',
'ray',
'road',
'rocket',
'rose',
'sea',
'seal',
'shark',
'shrew',
'skunk',
'skyscraper',
'snail',
'snake',
'spider',
'squirrel',
'streetcar',
'sunflower',
'sweet_pepper',
'table',
'tank',
'telephone',
'television',
'tiger',
'tractor',
'train',
'trout',
'tulip',
'turtle',
'wardrobe',
'whale',
'willow_tree',
'wolf',
'woman',
'worm',
]