3
HXM @ s d Z ddlmZ ddlZddlZddlmZmZ ddlm Z ddl
m Z dd Z d d
Z
G d d d eZG d
d deZd ddZejdZdd Zd ddZd ddZd d ZdS )!z
babel.messages.pofile
~~~~~~~~~~~~~~~~~~~~~
Reading and writing of files in the ``gettext`` PO (portable object)
format.
:copyright: (c) 2013 by the Babel Team.
:license: BSD, see LICENSE for more details.
)print_functionN)CatalogMessage)wraptext) text_typec C s" dd }t jdj|| dd S )zReverse `escape` the given string.
>>> print(unescape('"Say:\\n \\"hello, world!\\"\\n"'))
Say:
"hello, world!"
:param string: the string to unescape
c S s2 | j d}|dkrdS |dkr"dS |dkr.dS |S )N n
t r
)group)matchm r /usr/lib/python3.6/pofile.pyreplace_escapes s
z!unescape..replace_escapesz \\([\\trn"])r )recompilesub)stringr r r r unescape s
r c C sF d| kr:| j }| jdr&|dd }tt|}dj|S t| S dS )a Reverse the normalization done by the `normalize` function.
>>> print(denormalize(r'''""
... "Say:\n"
... " \"hello, world!\"\n"'''))
Say:
"hello, world!"
>>> print(denormalize(r'''""
... "Say:\n"
... " \"Lorem ipsum dolor sit "
... "amet, consectetur adipisicing"
... " elit, \"\n"'''))
Say:
"Lorem ipsum dolor sit amet, consectetur adipisicing elit, "
:param string: the string to denormalize
r z""r N )
splitlines
startswithmapr join)r Z
escaped_lineslinesr r r denormalize- s
r c @ s, e Zd Zdd Zdd Zdd Zdd Zd S )
_NormalizedStringc G s" g | _ x|D ]}| j| q W d S )N)_strsappend)selfargsargr r r __init__N s
z_NormalizedString.__init__c C s | j j|j d S )N)r" r# strip)r$ sr r r r# S s z_NormalizedString.appendc C s dj tt| jS )Nr )r r r r" )r$ r r r r V s z _NormalizedString.denormalizec C s
t | jS )N)boolr" )r$ r r r __nonzero__Y s z _NormalizedString.__nonzero__N)__name__
__module__ __qualname__r' r# r r+ r r r r r! L s r! c @ sr e Zd ZdZddddgZd ddZd d
Zd d Zd
d Zd ddZ d ddZ
dd Z dd Z dd Z
dd ZdS ) PoFileParserzSupport class to read messages from a ``gettext`` PO (portable object) file
and add them to a `Catalog`
See `read_po` for simple cases.
msgidmsgstrmsgctxt msgid_pluralFc C s$ || _ || _d| _d| _| j d S )Nr )catalogignore_obsoletecounteroffset_reset_message_state)r$ r4 r5 r r r r' k s
zPoFileParser.__init__c C sF g | _ g | _g | _g | _g | _g | _d | _d| _d| _d| _ d| _
d S )NF) messages translations locationsflags
user_comments
auto_commentscontextobsoletein_msgid in_msgstr
in_msgctxt)r$ r r r r8 r s z!PoFileParser._reset_message_statec
C s@ | j j t| jdkr.tdd | jD }n| jd j }t|ttfrdd t| j j
D }x<| j D ]2\}}|| j j
kr| j d| j d qh|j ||< qhW t|}n| j d d j }| j
r| j
j }nd}t||t| jt| j| j| j| j d |d }| jr | js&|| j j|< n
|| j |< | jd7 _| j dS )
z
Add a message to the catalog based on the current parser state and
clear the state ready to process the next message.
r c S s g | ] }|j qS r )r ).0r r r r
s z-PoFileParser._add_message..r c S s g | ]}d qS )r r )rD _r r r rE s r z5msg has more translations than num_plurals of catalogN)linenor? )r: sortlenr9 tupler
isinstancelistranger4 num_plurals_invalid_pofiler7 r? r r; setr< r> r= r@ r5 r6 r8 )r$ r0 r idxZ translationr2 messager r r _add_message s2
zPoFileParser._add_messagec C s | j r| j d S )N)r9 rS )r$ r r r _finish_current_message s z$PoFileParser._finish_current_messagec C s* |j dr| j|| n| j||| d S )N")r !_process_string_continuation_line_process_keyword_line)r$ rG liner@ r r r _process_message_line s
z"PoFileParser._process_message_linec C s xL| j D ]0}|j|r|t| d
kr|t|d }P qW | j||d d S |dkr^| j || _|dkrr|| _|dkrd| _d| _| j j
t | n|d kr d| _d| _ |jdr|d
d j
d d
\}}| jj
t|t |g n| jj
d t |g n|dkrd| _t || _d S )N [z0Start of line didn't match any expected keyword.r0 r2 r3 FTr1 r ]r )rZ r[ )r0 r2 )r0 r3 ) _keywordsr rI rO rT r@ r7 rC rA r9 r# r! rB splitr: intr? )r$ rG rX r@ keywordr& rQ msgr r r rW s2
z"PoFileParser._process_keyword_linec C sV | j r| jd }n6| jr(| jd d }n | jr6| j}n| j||d d S |j| d S )Nr z | j |dd jdrx|dd j j D ]p}|jd}|dkryt||d d }W n tk
rt w0Y nX | jj|d | |f q0| jj|d f q0W n|dd jdrx|dd j jdD ]}| j j|j
qW nP|dd jdr"|dd j
}|r:| j j| n| j j|dd j
d S )Nr : r ,.)
rT r lstripr^ rfindr_
ValueErrorr; r# r< r( r> r= )r$ rX locationposrG flagcommentr r r _process_comment s&
z PoFileParser._process_commentc C s xt |D ]\}}|j }t|ts2|j| jj}|s8q
|jdr~|dd jdrr| j||dd j dd q| j
| q
| j|| q
W | j | j r| j
s| js| jr| jjtd | jjd tdg | j dS )
z
Reads from the file-like object `fileobj` and adds any po file
units found in it to the `Catalog` supplied to the constructor.
#r N~rc T)r@ z""r ) enumerater( rK r decoder4 charsetr rY rf rm rT r6 r< r= r> r9 r# r! r: rS )r$ fileobjrG rX r r r parse s
zPoFileParser.parsec C s" t d| t dj|d | d S )NzWARNING:z!WARNING: Problem on line {0}: {1}r )printformat)r$ rX rG ra r r r rO s
z PoFileParser._invalid_pofileN)F)F)F)r, r- r. __doc__r] r' r8 rS rT rY rW rV rm rt rO r r r r r/ ] s
#
& r/ Fc C s& t |||d}t||}|j| |S )aT Read messages from a ``gettext`` PO (portable object) file from the given
file-like object and return a `Catalog`.
>>> from datetime import datetime
>>> from babel._compat import StringIO
>>> buf = StringIO('''
... #: main.py:1
... #, fuzzy, python-format
... msgid "foo %(name)s"
... msgstr "quux %(name)s"
...
... # A user comment
... #. An auto comment
... #: main.py:3
... msgid "bar"
... msgid_plural "baz"
... msgstr[0] "bar"
... msgstr[1] "baaz"
... ''')
>>> catalog = read_po(buf)
>>> catalog.revision_date = datetime(2007, 4, 1)
>>> for message in catalog:
... if message.id:
... print((message.id, message.string))
... print(' ', (message.locations, sorted(list(message.flags))))
... print(' ', (message.user_comments, message.auto_comments))
(u'foo %(name)s', u'quux %(name)s')
([(u'main.py', 1)], [u'fuzzy', u'python-format'])
([], [])
((u'bar', u'baz'), (u'bar', u'baaz'))
([(u'main.py', 3)], [])
([u'A user comment'], [u'An auto comment'])
.. versionadded:: 1.0
Added support for explicit charset argument.
:param fileobj: the file-like object to read the PO file from
:param locale: the locale identifier or `Locale` object, or `None`
if the catalog is not bound to a locale (which basically
means it's a template)
:param domain: the message domain
:param ignore_obsolete: whether to ignore obsolete messages in the input
:param charset: the character set of the catalog.
)localedomainrr )r r/ rt )rs rx ry r5 rr r4 parserr r r read_po s .
r{ zL(\s+|[^\s\w]*\w+[a-zA-Z]-(?=\w+[a-zA-Z])|(?<=[\w\!\"\'\&\.\,\?])-{2,}(?=\w))c C s0 d| j ddj ddj ddj dd j d
d S ) zEscape the given string so that it can be included in double-quoted
strings in ``PO`` files.
>>> escape('''Say:
... "hello, world!"
... ''')
'"Say:\\n \\"hello, world!\\"\\n"'
:param string: the string to escape
z"%s"\z\\r z\tr
z\rr z\nrU z\")replace)r r r r escapeV s
r~ r L c
s> |r|dkrt }g }x| jdD ]}t t|| |krtj|}|j x|rg }d}xX|rt t|d
d | } || |k r|j|j || 7 }q^|s|j|j P q^W |jdj| qPW q$|j| q$W n
| jd}t |dkrt| S |r"|d r"|d = |d
d7 < ddj fdd |D S )a Convert a string into a format that is appropriate for .po files.
>>> print(normalize('''Say:
... "hello, world!"
... ''', width=None))
""
"Say:\n"
" \"hello, world!\"\n"
>>> print(normalize('''Say:
... "Lorem ipsum dolor sit amet, consectetur adipisicing elit, "
... ''', width=32))
""
"Say:\n"
" \"Lorem ipsum dolor sit "
"amet, consectetur adipisicing"
" elit, \"\n"
:param string: the string to normalize
:param prefix: a string that should be prepended to every line
:param width: the maximum line width; use `None`, 0, or a negative number
to completely disable line wrapping
r Trc r r r z""
c s g | ]} t | qS r )r~ )rD rX )prefixr r rE s z normalize..r r r r ) rI r r~ WORD_SEPr^ reverser# popr )
r r widthZ prefixlenr rX ZchunksZbufsizelr )r r normalizeh s6
r Tc
sT d fdd fddd!fdd }
d" fdd } d
} |rLd } n|rTd } xt | d
D ]}
|
js|rvqdj}rdkrg }x"|j D ]}|t|dd7 }qW dj|}|d x|
jD ] }|
| qW x|
jD ]}|
|dd qW |srg }xZt|
j D ]L\}}|rB| rB|j
d|j t j
d|f n|j
d|j t j
d qW |
dj|dd |
jrddjdgt|
j |
jr|r|
d |
jd d d t|
jd kr|
d |
jd d d | |
d qdW |sPxJt jj | d
D ]4}
x|
jD ]}|
| q$W | |
d d d qW d
S )#a Write a ``gettext`` PO (portable object) template file for a given
message catalog to the provided file-like object.
>>> catalog = Catalog()
>>> catalog.add(u'foo %(name)s', locations=[('main.py', 1)],
... flags=('fuzzy',))
>>> catalog.add((u'bar', u'baz'), locations=[('main.py', 3)])
>>> from babel._compat import BytesIO
>>> buf = BytesIO()
>>> write_po(buf, catalog, omit_header=True)
>>> print(buf.getvalue().decode("utf8"))
#: main.py:1
#, fuzzy, python-format
msgid "foo %(name)s"
msgstr ""
#: main.py:3
msgid "bar"
msgid_plural "baz"
msgstr[0] ""
msgstr[1] ""
:param fileobj: the file-like object to write to
:param catalog: the `Catalog` instance
:param width: the maximum line width for the generated output; use `None`,
0, or a negative number to completely disable line wrapping
:param no_location: do not emit a location comment for every message
:param omit_header: do not include the ``msgid ""`` entry at the top of the
output
:param sort_output: whether to sort the messages in the output by msgid
:param sort_by_file: whether to sort the messages in the output by their
locations
:param ignore_obsolete: whether to ignore obsolete messages and not include
them in the output; by default they are included as
comments
:param include_previous: include the old msgid as a comment when
updating the catalog
:param include_lineno: include line number in the location comment
r c s t | | dS )N)r r )r )keyr )r r r
_normalize s z write_po.._normalizec s& t | tr| j jd} j| d S )Nbackslashreplace)rK r encoderr write)text)r4 rs r r _write s
zwrite_po.._writec sB rdkr}nd}x&t | |D ]} d||j f q"W d S )Nr r z#%s %s
)r r( )rl r Z_widthrX )r r r r _write_comment s
z write_po.._write_commentc s t | jttfr| jr.d| | j|f d| | jd |f d| | jd |f xtjD ]D}y| j| }W n tk
r d}Y nX d|| ||f qrW nT| jrڈd| | j|f d| | j|f d| | jpd|f d S ) Nz
%smsgctxt %s
z %smsgid %s
r z%smsgid_plural %s
r r z%smsgstr[%d] %s
z %smsgstr %s
) rK idrL rJ r? rM rN r
IndexError)rR r rQ r )r r r4 r r _write_message s(
z write_po.._write_messageNrR ri )sort_byr z# )r Zsubsequent_indentr re )r z%s:%d/z%srZ rb z#%s
z, zmsgid %s|r zmsgid_plural %sz#~ )r )r )r )_sort_messagesr Zheader_commentr r r r= r> sortedr; r# r} ossepr< Z previous_idrI r@ values)rs r4 r Z no_locationZ omit_headerZ sort_outputZ sort_by_filer5 Zinclude_previousZinclude_linenor r r rR Zcomment_headerr rX rl ZlocsfilenamerG r )r r r4 rs r r write_po sf .
r c C s6 t | } |dkr| j n|dkr2| jdd d | S )z
Sort the given message iterable by the given criteria.
Always returns a list.
:param messages: An iterable of Messages.
:param sort_by: Sort by which criteria? Options are `message` and `location`.
:return: list[Message]
rR ri c S s | j S )N)r; )r r r r G s z _sort_messages..)r )rL rH )r9 r r r r r 9 s
r )NNFN)r r )r FFFFFFT)rw Z
__future__r r r Zbabel.messages.catalogr r Z
babel.utilr Z
babel._compatr r r objectr! r/ r{ r r r~ r r r r r r r s( ?
4
=