辞富居贫网

短网址解析长网址python示例

短网址解析长网址python示例

做可视化比较麻烦我就没做,短网用文件处理的址解,这里需要两个文件

1、析长readUrl.txt文件保存需要解析的网址字符串

2、newUrl.txt文件保存解析完成的示例字符串

目录

readUrl.txt文件示例

编码示例: 

推荐获取网页URL的正则

解析结果newUrl.txt


readUrl.txt文件示例

#接龙http://t.csdn.cn/DWodz1. CSDN-亮点 http://t.csdn.cn/DWodz2. 不知名白帽  http://t.csdn.cn/YO6Sm3. 编程爱好者-阿新 http://t.csdn.cn/4suuN4. 一一哥 https://yiyige.blog.csdn.net/article/details/1209904485. 执久 http://t.csdn.cn/4UCQf6. 花神庙码农@CSDNhttp://t.csdn.cn/t9moE7. 木木 http://t.csdn.cn/aalnU8. 挽·烽 http://t.csdn.cn/LaZIz高质量三连回访9. 六月暴雪飞梨花 http://t.csdn.cn/VqL0s10. 风铃听雨~ http://t.csdn.cn/9fkAT11. 东非不开森 http://t.csdn.cn/fZa8s 开学季征文 如有时间愿意看的,可以指点一下嘿嘿 谢谢啦🥰🥰12. 小明java问道之路 经验文 | 编程的短网上帝视角是什么?感兴趣的可以看看http://t.csdn.cn/ffDdq硬核深度文 | 精通内核-CPU控制并发原理CPU中断控制http://t.csdn.cn/UZ6kN💖在线求个一键三连💖13. AKA|布鲁克林欧神仙 https://blog.csdn.net/m0_54594153/article/details/126661839?spm=1001.2014.3001.5501高质量三连回访14. 阿提说说 http://t.csdn.cn/K3KSU15. DDD666🍭 http://t.csdn.cn/2zn4R16. 付文龙(爱吃回锅肉)红目香薰 http://t.csdn.cn/kqcPv17. Bourne http://t.csdn.cn/ndJvc18. 秦羽 http://t.csdn.cn/nn0cO19. 宁采桃花不采臣 http://t.csdn.cn/nqgEK2.​Code For Better20. CSDN-北极的三哈http://t.csdn.cn/Zn1WF21. promise https://blog.csdn.net/m0_71485750/article/details/126427221  互三互粉22. Beyond https://blog.csdn.net/chuxinchangcun/article/details/126681915

编码示例: 

import requestsimport refile = open("readUrl.txt", "r", encoding="utf-8")strListArr = file.readlines()strList = "".join(strListArr)file.close()headers = {     "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36"}rep="http[s]?://(?:[a-zA-Z]|[0-9]|[$-_@.&+]|[!*\(\),]|(?:%[0-9a-fA-F][0-9a-fA-F]))+"listUrl = re.findall(rep, strList)list_not_dup = list()for i in listUrl:    if i not in list_not_dup:        list_not_dup.append(i)for item in list_not_dup:    print(item)strUrl = ""for item in list_not_dup:    html = requests.get(item, headers).url    result = html.split("?")    strUrl += result[0] + "\n"file = open("newUrl.txt", "w", encoding="utf-8")file.write(strUrl)file.close()

推荐获取网页URL的正则

"http[s]?://(?:[a-zA-Z]|[0-9]|[$-_@.&+]|[!*\(\),]|(?:%[0-9a-fA-F][0-9a-fA-F]))+" 

解析结果newUrl.txt

https://blog.csdn.net/CSDN_anhl/article/details/126240868https://blog.csdn.net/m0_63127854/article/details/126682845https://blog.csdn.net/m0_47419053/article/details/126679490https://yiyige.blog.csdn.net/article/details/120990448https://blog.csdn.net/weixin_60719453/article/details/126674166https://blog.csdn.net/qxhgd/article/details/115391385https://blog.csdn.net/m0_64102491/article/details/126673956https://blog.csdn.net/Fire_Cloud_1/article/details/126669683https://blog.csdn.net/L_Lycos/article/details/126614374https://blog.csdn.net/muzi_longren/article/details/126654597https://blog.csdn.net/m0_62159662/article/details/126653214https://blog.csdn.net/FMC_WBL/article/details/126683043https://blog.csdn.net/FMC_WBL/article/details/126575914https://blog.csdn.net/m0_54594153/article/details/126661839https://blog.csdn.net/weixin_40972073/article/details/126682094https://blog.csdn.net/BIT_666/article/details/126656554https://blog.csdn.net/feng8403000/article/details/126674232https://blog.csdn.net/qq_44631587/article/details/126667516https://blog.csdn.net/qq_43585922/article/details/126685211https://blog.csdn.net/m0_65909361/article/details/126599073https://blog.csdn.net/m0_68744965/article/details/126471630https://blog.csdn.net/m0_71485750/article/details/126427221https://blog.csdn.net/chuxinchangcun/article/details/126681915

未经允许不得转载:辞富居贫网 » 短网址解析长网址python示例