Programming Notes

Fixing Recurring urllib.error Messages in stable-diffusion-web-ui

March 24, 2024

When you see errors such as urllib HTTP Error 403: Forbidden, locate the ui_extensions.py file and modify the content under refresh_available_extensions as follows:

def refresh_available_extensions(url, hide_tags, sort_column):
    global available_extensions
    import random
    import urllib.request

    opener = urllib.request.build_opener()
    # Build a list of request headers and pick one at random each time
    ua_list = ['Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0',
           'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36',
           'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.5060.114 Safari/537.36 Edg/103.0.1264.62',
           'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:98.0) Gecko/20100101 Firefox/98.0',
           'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.81 Safari/537.36 SE 2.X MetaSr 1.0'
           ]
    opener.addheaders = [('User-Agent', random.choice(ua_list))]
    urllib.request.install_opener(opener)
    
    res = urllib.request.urlopen(url)
    text = res.read().decode('utf-8')
    
    available_extensions = json.loads(text)

    code, tags = refresh_available_extensions_from_data(hide_tags, sort_column)

    return url, code, gr.CheckboxGroup.update(choices=tags), '', ''