Python re module (regular expressions)

regular expressions (RE) 简介

  re模块是python中处理正在表达式的一个模块

  1 r"""Support for regular expressions (RE).
  2
  3 This module provides regular expression matching operations similar to
  4 those found in Perl.  It supports both 8-bit and Unicode strings; both
  5 the pattern and the strings being processed can contain null bytes and
  6 characters outside the US ASCII range.
  7
  8 Regular expressions can contain both special and ordinary characters.
  9 Most ordinary characters, like "A", "a", or "0", are the simplest
 10 regular expressions; they simply match themselves.  You can
 11 concatenate ordinary characters, so last matches the string ‘last‘.
 12
 13 The special characters are:
 14     "."      Matches any character except a newline.
 15     "^"      Matches the start of the string.
 16     "$"      Matches the end of the string or just before the newline at
 17              the end of the string.
 18     "*"      Matches 0 or more (greedy) repetitions of the preceding RE.
 19              Greedy means that it will match as many repetitions as possible.
 20     "+"      Matches 1 or more (greedy) repetitions of the preceding RE.
 21     "?"      Matches 0 or 1 (greedy) of the preceding RE.
 22     *?,+?,?? Non-greedy versions of the previous three special characters.
 23     {m,n}    Matches from m to n repetitions of the preceding RE.
 24     {m,n}?   Non-greedy version of the above.
 25     "\\"     Either escapes special characters or signals a special sequence.
 26     []       Indicates a set of characters.
 27              A "^" as the first character indicates a complementing set.
 28     "|"      A|B, creates an RE that will match either A or B.
 29     (...)    Matches the RE inside the parentheses.
 30              The contents can be retrieved or matched later in the string.
 31     (?aiLmsux) Set the A, I, L, M, S, U, or X flag for the RE (see below).
 32     (?:...)  Non-grouping version of regular parentheses.
 33     (?P<name>...) The substring matched by the group is accessible by name.
 34     (?P=name)     Matches the text matched earlier by the group named name.
 35     (?#...)  A comment; ignored.
 36     (?=...)  Matches if ... matches next, but doesn‘t consume the string.
 37     (?!...)  Matches if ... doesn‘t match next.
 38     (?<=...) Matches if preceded by ... (must be fixed length).
 39     (?<!...) Matches if not preceded by ... (must be fixed length).
 40     (?(id/name)yes|no) Matches yes pattern if the group with id/name matched,
 41                        the (optional) no pattern otherwise.
 42
 43 The special sequences consist of "\\" and a character from the list
 44 below.  If the ordinary character is not on the list, then the
 45 resulting RE will match the second character.
 46     \number  Matches the contents of the group of the same number.
 47     \A       Matches only at the start of the string.
 48     \Z       Matches only at the end of the string.
 49     \b       Matches the empty string, but only at the start or end of a word.
 50     \B       Matches the empty string, but not at the start or end of a word.
 51     \d       Matches any decimal digit; equivalent to the set [0-9] in
 52              bytes patterns or string patterns with the ASCII flag.
 53              In string patterns without the ASCII flag, it will match the whole
 54              range of Unicode digits.
 55     \D       Matches any non-digit character; equivalent to [^\d].
 56     \s       Matches any whitespace character; equivalent to [ \t\n\r\f\v] in
 57              bytes patterns or string patterns with the ASCII flag.
 58              In string patterns without the ASCII flag, it will match the whole
 59              range of Unicode whitespace characters.
 60     \S       Matches any non-whitespace character; equivalent to [^\s].
 61     \w       Matches any alphanumeric character; equivalent to [a-zA-Z0-9_]
 62              in bytes patterns or string patterns with the ASCII flag.
 63              In string patterns without the ASCII flag, it will match the
 64              range of Unicode alphanumeric characters (letters plus digits
 65              plus underscore).
 66              With LOCALE, it will match the set [0-9_] plus characters defined
 67              as letters for the current locale.
 68     \W       Matches the complement of \w.
 69     \\       Matches a literal backslash.
 70
 71 This module exports the following functions:
 72     match     Match a regular expression pattern to the beginning of a string.
 73     fullmatch Match a regular expression pattern to all of a string.
 74     search    Search a string for the presence of a pattern.
 75     sub       Substitute occurrences of a pattern found in a string.
 76     subn      Same as sub, but also return the number of substitutions made.
 77     split     Split a string by the occurrences of a pattern.
 78     findall   Find all occurrences of a pattern in a string.
 79     finditer  Return an iterator yielding a match object for each match.
 80     compile   Compile a pattern into a RegexObject.
 81     purge     Clear the regular expression cache.
 82     escape    Backslash all non-alphanumerics in a string.
 83
 84 Some of the functions in this module takes flags as optional parameters:
 85     A  ASCII       For string patterns, make \w, \W, \b, \B, \d, \D
 86                    match the corresponding ASCII character categories
 87                    (rather than the whole Unicode categories, which is the
 88                    default).
 89                    For bytes patterns, this flag is the only available
 90                    behaviour and needn‘t be specified.
 91     I  IGNORECASE  Perform case-insensitive matching.
 92     L  LOCALE      Make \w, \W, \b, \B, dependent on the current locale.
 93     M  MULTILINE   "^" matches the beginning of lines (after a newline)
 94                    as well as the string.
 95                    "$" matches the end of lines (before a newline) as well
 96                    as the end of the string.
 97     S  DOTALL      "." matches any character at all, including the newline.
 98     X  VERBOSE     Ignore whitespace and comments for nicer looking RE‘s.
 99     U  UNICODE     For compatibility only. Ignored for string patterns (it
100                    is the default), and forbidden for bytes patterns.
101
102 This module also defines an exception ‘error‘.
103
104 """

虽然在Python 中使用正则表达式有几个步骤,但每一步都相当简单。
1.用import re 导入正则表达式模块。
2.用re.compile()函数创建一个Regex 对象(记得使用原始字符串)。
3.向Regex 对象的search()方法传入想查找的字符串。它返回一个Match 对象。
4.调用Match 对象的group()方法,返回实际匹配文本的字符串。

              向re.compile()传递原始字符串
Python 中转义字符使用倒斜杠(\)。字符串‘\n‘表示一个换行字符,
而不是倒斜杠加上一个小写的n。你需要输入转义字符\\,才能打印出一个倒斜杠。
所以‘\\n‘表示一个倒斜杠加上一个小写的n。但是,通过在字符串的第一个引号之
前加上r,可以将该字符串标记为原始字符串,它不包括转义字符。
因为正则表达式常常使用倒斜杠,向re.compile()函数传入原始字符串就很方
便, 而不是输入额外得到斜杠。
输入r‘\d\d\d-\d\d\d-\d\d\d\d‘ ,
比输入‘\\d\\d\\d-\\d\\d\\d-\\d\\d\\d\\d‘要容易得多。

1.compile()

  • python代码最终会被编译为字节码,之后才被解释器执行。
  • 在模式匹配之前,正在表达式模式必须先被编译成regex对象,预先编译可以提高性能,re.compile()就是用于提供此功能。

def compile(pattern, flags=0):
    "Compile a regular expression pattern, returning a pattern object."
    return _compile(pattern, flags)

2. findall(pattern, string, flags=0)

  • matchsearch均用于匹配单值,即:只能匹配字符串中的一个,如果想要匹配到字符串中所有符合条件的元素,则需要使用 findall
  • findall,获取非重复的匹配列表;
  1. 如果有一个组则以列表形式返回,且每一个匹配均是字符串;
  2. 如果模型中有多个组,则以列表形式返回,且每一个匹配均是元祖;空的匹配也会包含在结果中

def findall(pattern, string, flags=0):
    """Return a list of all non-overlapping matches in the string.

    If one or more capturing groups are present in the pattern, return
    a list of groups; this will be a list of tuples if the pattern
    has more than one group.

    Empty matches are included in the result."""
    return _compile(pattern, flags).findall(string)

3. match(pattern, string, flags=0)

  从字符串的开头进行匹配, 匹配成功就返回一个匹配对象,匹配失败就返回None

  flags的几种值:

  1. X 忽略空格和注释
  2. I 忽略大小写的区别 case-insensitive matching
  3. S . 匹配任意字符,包括新行

def match(pattern, string, flags=0):
    """Try to apply the pattern at the start of the string, returning
    a match object, or None if no match was found."""
    return _compile(pattern, flags).match(string)

4. search(pattern, string, flags=0)

  浏览整个字符串去匹配第一个,未匹配成功返回None

def search(pattern, string, flags=0):
    """Scan through string looking for a match to the pattern, returning
    a match object, or None if no match was found."""
    return _compile(pattern, flags).search(string)

  • search() vs. match()

# Python offers two different primitive operations based on regular expressions:
# re.match() checks for a match only at the beginning of the string,
# while re.search() checks for a match anywhere in the string (this is what Perl does by default).

>>> re.match("c", "abcdef")    # No match
>>> re.search("c", "abcdef")   # Match
<_sre.SRE_Match object at ...>

# Regular expressions beginning with ‘^‘ can be used with search() to restrict the match at the beginning of the string:
# re.match(‘str‘, "string")  等价于  re.search(‘^str‘, "string")
>>> re.match("c", "abcdef")    # No match
>>> re.search("^c", "abcdef")  # No match
>>> re.search("^a", "abcdef")  # Match
<_sre.SRE_Match object at ...>

# Note however that in MULTILINE mode match() only matches at the beginning of the string,
# whereas using search() with a regular expression beginning with ‘^‘ will match at the beginning of each line.
# 多行匹配 模式 对 match() 无效
# 带^的正则匹配 search() 在 多行匹配 模式下,会去 字符串的每一行 匹配 要查找的字符或字符串

>>> re.match(‘X‘, ‘A\nB\nX‘, re.MULTILINE)  # No match
>>> re.search(‘^X‘, ‘A\nB\nX‘, re.MULTILINE)  # Match
<_sre.SRE_Match object at ...>

5. sub(pattern,repl,string,count=0,flags=0)

  替换匹配成功的指定位置字符串

def sub(pattern, repl, string, count=0, flags=0):
    """Return the string obtained by replacing the leftmost
    non-overlapping occurrences of the pattern in string by the
    replacement repl.  repl can be either a string or a callable;
    if a string, backslash escapes in it are processed.  If it is
    a callable, it‘s passed the match object and must return
    a replacement string to be used."""
    return _compile(pattern, flags).sub(repl, string, count)

6. split(pattern,string,maxsplit=0,flags=0)
  根据正则匹配分割字符串

def split(pattern, string, maxsplit=0, flags=0):
    """Split the source string by the occurrences of the pattern,
    returning a list containing the resulting substrings.  If
    capturing parentheses are used in pattern, then the text of all
    groups in the pattern are also returned as part of the resulting
    list.  If maxsplit is nonzero, at most maxsplit splits occur,
    and the remainder of the string is returned as the final element
    of the list."""
    return _compile(pattern, flags).split(string, maxsplit)

7. group()与groups()

匹配对象的两个主要方法:

group()   返回所有匹配对象,或返回某个特定子组,如果没有子组,返回全部匹配对象

groups() 返回一个包含唯一或所有子组的的元组,如果没有子组,返回空元组

原文地址:https://www.cnblogs.com/51try-again/p/10255210.html

时间: 2024-10-13 22:17:05

Python re module (regular expressions)的相关文章

Using Regular Expressions in Python

1. 反斜杠的困扰(The Backslash) 有时候需要匹配的文本带有'\',如'\python',因为正则表达式有些特殊字符有特殊意义,所以需要前面加上'\'来消除特殊意义,这里匹配的正则表达式是'\\python',这时候如果要编译这个正则表达式需要re.compile('\\\\python'),因为在传递字符串的时候python本身就需要用'\\'来表示'\',也就造成了反斜杠的泛滥. 使用前缀'r'可以解决这个问题:’r'之后的'\'只是这个字符本身而没有特殊意义,比如r'\n'表

PCRE Perl Compatible Regular Expressions Learning

catalog 1. PCRE Introduction 2. pcre2api 3. pcre2jit 4. PCRE Programing 1. PCRE Introduction The PCRE library is a set of functions that implement regular expression pattern matching using the same syntax and semantics as Perl 5. PCRE has its own nat

[转]8 Regular Expressions You Should Know

Regular expressions are a language of their own. When you learn a new programming language, they're this little sub-language that makes no sense at first glance. Many times you have to read another tutorial, article, or book just to understand the "s

[Python]attributeError:&#39;module&#39; object has no attribute &#39;dump&#39;

[问题] [代码] 文件名:pickle.py # coding=utf-8 #持久存储 import pickle #b 以二进制的模式打开文件 with open('mydata.pickle','wb') as mysavedata: #用dump保存数据 pickle.dump([1,2,'three'],mysavedata) #b 以二进制的模式打开文件 with open('mydata.pickle','rb') as myreaddata: #使用load恢复数据 list =

Python正则表达式 re(regular expression)

1. 点. .: 代表一个字符 (这个跟linux的正则表达式是不同的,那里.代表的是后面字符的一次或0次出现) 2. 转义 \\ 或者 r'\': 如 r'python\.org' (对.符号的转义) 3. ^ 非或叫做排除 如[^abc]: 任何以非a,b,c的字符 4. | 选择符 如python|perl (从python和perl选择一个) 也可以: p(ython|erl) 5. ? 可选项 如: r'(http://)?(www\.)?python\.org' (http://和w

anaconda python no module named &#39;past&#39;的解决方法

如上图所示,错误就是:No module named 'past' 解决办法不是下载'past'包,而是下载'future'包: 我是安装了anaconda集成环境,python的单独环境应该也是同样的,下面以anaconda安装 'future'包为例,命令是" pip install future",如下图: 成功安装即可解决这个问题(? ω ?) anaconda python no module named 'past'的解决方法

Python Keras module &#39;keras.backend&#39; has no attribute &#39;image_data_format&#39;

问题: 当使用Keras运行示例程序mnist_cnn时,出现如下错误: 'keras.backend' has no attribute 'image_data_format' 程序路径https://github.com/fchollet/keras/blob/master/examples/mnist_cnn.py 使用的python conda环境是udacity自动驾驶课程的carnd-term1 故障程序段: if K.image_data_format() == 'channels

8 Regular Expressions You Should Know

Regular expressions are a language of their own. When you learn a new programming language, they're this little sub-language that makes no sense at first glance. Many times you have to read another tutorial, article, or book just to understand the "s

Finding Comments in Source Code Using Regular Expressions

Many text editors have advanced find (and replace) features. When I’m programming, I like to use an editor with regular expression search and replace. This feature is allows one to find text based on complex patterns rather than based just on literal