Comments on: Replacing URLs with links… halp?

By: rajbot

rajbot — Thu, 25 Feb 2010 19:34:14 +0000

Thanks AGAIN! Updated!!

By: shag

shag — Tue, 09 Feb 2010 03:46:21 +0000

Ok, here’s a revised regex:

    prog = re.compile(r'(?#FQURL)(?:(?#Protocol)(?:(?:ht|f)tp(?:s?)\:\/\/)(?#Username:Password)(?:\w+:\w+@)?(?#Subdomains)(?:(?:[-\w]+\.)*(?#TopLevel Domains)(?:[a-z]+\.?))(?#Port)(?::[\d]{1,5})?\.?(?#Directories)(?:(?:(?:\/(?:[-\w~!$+|.,=]|%[a-f\d]{2})+)+|\/|)+|\?|#)?(?#Query)(?:(?:\?(?:[-\w~!$+|.,*:]|%[a-f\d{2}])+=?(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)(?:&(?:[-\w~!$+|.,*:]|%[a-f\d{2}])+=?(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)*)*(?#Anchor)(?:#(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)?|(?#BareURL)(?#Username:Password)(?:\w+:\w+@)?(?#Subdomains)(?:(?:[-\w]+\.)+(?#TopLevel Domains)(?:com|org|net|gov|mil|biz|info|mobi|name|aero|jobs|museum|travel|[a-z]{2}))(?#Port)(?::[\d]{1,5})?\.?(?#Directories)(?:(?:(?:\/(?:[-\w~!$+|.,=]|%[a-f\d]{2})+)+|\/|)+|\?|#)?(?#Query)(?:(?:\?(?:[-\w~!$+|.,*:]|%[a-f\d{2}])+=?(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)(?:&(?:[-\w~!$+|.,*:]|%[a-f\d{2}])+=?(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)*)*(?#Anchor)(?:#(?:[-\w~!$+|.,*:=]|%[a-f\d]{2})*)?)')

that handles this new test case now:

print convertLinks('words with slashes: unread/unregistered\n')

By: shag

shag — Tue, 09 Feb 2010 00:07:55 +0000

Looks like there is a bug: it turned the ‘unresponded’ in

“unread/unresponded”

into a link to /responded … hmmm ….

By: rajbot

rajbot — Thu, 04 Feb 2010 23:28:37 +0000

Thanks again, shag! The hashtags should now be linked!

Stupid WP keeps re-inserting the rel=nofollow stuff. I couldn’t find how to turn it off.. will keep looking.

By: rajbot

rajbot — Thu, 04 Feb 2010 21:52:07 +0000

stupid wordpress is stupid

By: shag

shag — Thu, 04 Feb 2010 20:50:28 +0000

yuck, wordpress totally mangled teh python! lame :-( that <1 rel nofollow> business should just be <1>

By: shag

shag — Thu, 04 Feb 2010 20:47:41 +0000

This should convert the #foo and @bar…

#!/usr/bin/python
 
import re
 
def convertTopicsAndTwitterers(str):
    prog = re.compile(r'#(\w+)')
    str = prog.sub(r'#\g<1 rel="nofollow">">\g<1>', str)
    prog2 = re.compile(r'@(\w+)')
    return prog2.sub(r'@\g<1 rel="nofollow">">\g<1>', str)
 
#
print convertTopicsAndTwitterers('@peliom: #svlug foo #bar')

By: rajbot

rajbot — Thu, 04 Feb 2010 19:16:49 +0000

Converting to

 on the above…



By: rajbot
rajbot — Thu, 04 Feb 2010 19:13:53 +0000
Finally found these in the akismet spam panel.. sigh



By: shag
shag — Thu, 04 Feb 2010 18:49:11 +0000
Here are the test cases I used, most from your earlier tests Raj:

 
#single url        
print convertLinks('http://tikirobot.net\n')
 
#string
print convertLinks('See http://tikirobot.net for more info.\n')
 
#string w/ anchor
print convertLinks('See http://tikirobot.net/#foo for more info.\n')
 
#two urls in a string
print convertLinks('See http://tikirobot.net or http://wikipedia.org for more info.\n')
 
#some test urls from flanders.co.nz
print convertLinks('This is a google search: http://www.google.com/search?q=good+url+regex&rls=com.microsoft:*&ie=UTF-8&oe=UTF-8&startIndex=&startPage=1\n')
 
print convertLinks('ftp://joe:password@ftp.filetransferprotocal.com is a ftp url\n')
 
print convertLinks('There is a bare url google.ru somewhere in this sentence\n')
 
print convertLinks('both a query string and an anchor: https://some-url.com/?query=&name=joe&filter=*.*\n')
 
print convertLinks('both a query string and an anchor: https://some-url.com?query=&name=joe?filter=*.*#some_anchor\n')
 
print convertLinks('both a query string and an anchor: https://some-url.com/?query=&name=joe&filter=*.*#some_anchor\n')
 
print convertLinks('DNS name with a concluding period: http://some-url.com./\n')
 
print convertLinks('DNS name with a concluding period and query string: http://some-url.com./?foo=bar\n')
 
print convertLinks('single-component DNS name plus root: http://to./\n')
 
print convertLinks('single-component DNS name: http://to/\n')