Файловый менеджер - Редактировать - /usr/lib/python3/dist-packages/pip/_vendor/pygments/__pycache__/lexer.cpython-310.pyc
Ðазад
o !��h�| � @ s� d Z ddlZddlZddlZddlmZmZ ddlmZ ddl m Z m Z m Z m Z ddlmZmZmZmZmZmZ ddlmZ g d�Zg d �Zed d � �ZG d d � d e�Z G dd� de d�Z G dd� de �Z G dd� de �Z G dd� d�Z!e!� Z"G dd� de#�Z$G dd� d�Z%dd � Z&G d d � d �Z'e'� Z(d d � Z)G d!d"� d"�Z*G d#d$� d$e�Z+G d%d&� d&e �Z,G d'd(� d(e e,d�Z-G d)d*� d*�Z.G d+d,� d,e-�Z/d-d.� Z0G d/d0� d0e,�Z1G d1d2� d2e-e1d�Z2dS )3z� pygments.lexer ~~~~~~~~~~~~~~ Base lexer classes. :copyright: Copyright 2006-2021 by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. � N)� apply_filters�Filter)�get_filter_by_name)�Error�Text�Other� _TokenType)� get_bool_opt� get_int_opt� get_list_opt�make_analysator�Future� guess_decode)� regex_opt) �Lexer� RegexLexer�ExtendedRegexLexer�DelegatingLexer� LexerContext�include�inherit�bygroups�using�this�default�words))s �utf-8)s �� zutf-32)s ��zutf-32be)s ��zutf-16)s ��zutf-16bec C � dS )N� � ��xr r �</usr/lib/python3/dist-packages/pip/_vendor/pygments/lexer.py�<lambda>! � r# c @ � e Zd ZdZdd� ZdS )� LexerMetaz� This metaclass automagically converts ``analyse_text`` methods into static methods which always return float values. c C s( d|v r t |d �|d< t�| |||�S )N� analyse_text)r �type�__new__)�mcs�name�bases�dr r r" r) * s zLexerMeta.__new__N)�__name__� __module__� __qualname__�__doc__r) r r r r" r& $ s r& c @ sZ e Zd ZdZdZg Zg Zg Zg ZdZ dd� Z dd� Z dd � Z d d � Z dd d�Zdd� ZdS )r a� Lexer for a specific language. Basic options recognized: ``stripnl`` Strip leading and trailing newlines from the input (default: True). ``stripall`` Strip all leading and trailing whitespace from the input (default: False). ``ensurenl`` Make sure that the input ends with a newline (default: True). This is required for some lexers that consume input linewise. .. versionadded:: 1.3 ``tabsize`` If given and greater than 0, expand tabs in the input (default: 0). ``encoding`` If given, must be an encoding name. This encoding will be used to convert the input string to Unicode, if it is not already a Unicode string (default: ``'guess'``, which uses a simple UTF-8 / Locale / Latin1 detection. Can also be ``'chardet'`` to use the chardet library, if it is installed. ``inencoding`` Overrides the ``encoding`` if given. Nr c K s� || _ t|dd�| _t|dd�| _t|dd�| _t|dd�| _|�dd �| _|�d �p-| j| _g | _ t |d d �D ]}| � |� q8d S ) N�stripnlT�stripallF�ensurenl�tabsizer �encoding�guess� inencoding�filtersr ) �optionsr r2 r3 r4 r r5 �getr6 r9 r � add_filter)�selfr: �filter_r r r" �__init__^ s �zLexer.__init__c C s$ | j r d| jj| j f S d| jj S )Nz <pygments.lexers.%s with %r>z<pygments.lexers.%s>)r: � __class__r. �r= r r r" �__repr__j s � zLexer.__repr__c K s* t |t�s t|fi |��}| j�|� dS )z8 Add a new stream filter to this lexer. N)� isinstancer r r9 �append)r= r> r: r r r" r< q s zLexer.add_filterc C r )a~ Has to return a float between ``0`` and ``1`` that indicates if a lexer wants to highlight this text. Used by ``guess_lexer``. If this method returns ``0`` it won't highlight it in any case, if it returns ``1`` highlighting with this lexer is guaranteed. The `LexerMeta` metaclass automatically wraps this function so that it works like a static method (no ``self`` or ``cls`` parameter) and the return value is automatically converted to `float`. If the return value is an object that is boolean `False` it's the same as if the return values was ``0.0``. Nr )�textr r r" r' y r$ zLexer.analyse_textFc s� t �t�s{� jdkrt��\�}nw� jdkrgzddlm} W n ty/ } ztd�|�d}~ww d}tD ]\}}��|�rK�t |�d� � |d�} nq4|du rd|� �dd� �} �� | � d �pad d�}|�n!�� � j����d �rz�t d �d� �n ��d �r��t d �d� ��� d d ���� dd ��� jr���� �n� jr���d ��� jdkr���� j��� jr���d �s��d 7 �� �fdd�} | � } |s�t| � j� �} | S )a= Return an iterable of (tokentype, value) pairs generated from `text`. If `unfiltered` is set to `True`, the filtering mechanism is bypassed even if filters are defined. Also preprocess the text, i.e. expand tabs and strip it if wanted and applies registered filters. r7 �chardetr )rF zkTo enable chardet encoding guessing, please install the chardet library from http://chardet.feedparser.org/N�replacei r6 r u z � � c 3 s& � � � ��D ] \} }}||fV qd S �N)�get_tokens_unprocessed)�_�t�v�r= rE r r" �streamer� s � �z"Lexer.get_tokens.<locals>.streamer)rC �strr6 r � pip._vendorrF � ImportError� _encoding_map� startswith�len�decode�detectr; rG r3 �stripr2 r5 � expandtabsr4 �endswithr r9 ) r= rE � unfilteredrL rF �e�decoded�bomr6 �encrP �streamr rO r" � get_tokens� sZ ��� �� � zLexer.get_tokensc C s t �)z� Return an iterable of (index, tokentype, value) pairs where "index" is the starting position of the token within the input text. In subclasses, implement this method as a generator to maximize effectiveness. )�NotImplementedErrorrO r r r" rK � s z Lexer.get_tokens_unprocessed)F)r. r/ r0 r1 r+ �aliases� filenames�alias_filenames� mimetypes�priorityr? rB r< r' rb rK r r r r" r 0 s ;r )� metaclassc @ s$ e Zd ZdZefdd�Zdd� ZdS )r a This lexer takes two lexer as arguments. A root lexer and a language lexer. First everything is scanned using the language lexer, afterwards all ``Other`` tokens are lexed using the root lexer. The lexers from the ``template`` lexer package use this base lexer. c K s< |di |��| _ |di |��| _|| _tj| fi |�� d S �Nr )� root_lexer�language_lexer�needler r? )r= � _root_lexer�_language_lexer�_needler: r r r" r? � s zDelegatingLexer.__init__c C s� d}g }g }| j �|�D ]$\}}}|| ju r(|r#|�t|�|f� g }||7 }q |�|||f� q |r<|�t|�|f� t|| j�|��S )N� )rl rK rm rD rV � do_insertionsrk )r= rE �buffered� insertions� lng_buffer�irM rN r r r" rK � s �z&DelegatingLexer.get_tokens_unprocessedN)r. r/ r0 r1 r r? rK r r r r" r � s r c @ � e Zd ZdZdS )r zI Indicates that a state should include rules from another state. N�r. r/ r0 r1 r r r r" r � s r c @ r% )�_inheritzC Indicates the a state should inherit from its superclass. c C r )Nr r rA r r r" rB � � z_inherit.__repr__N)r. r/ r0 r1 rB r r r r" ry � s ry c @ s e Zd ZdZdd� Zdd� ZdS )�combinedz: Indicates a state combined from multiple states. c G s t �| |�S rJ )�tupler) )�cls�argsr r r" r) s zcombined.__new__c G s d S rJ r )r= r~ r r r" r? s zcombined.__init__N)r. r/ r0 r1 r) r? r r r r" r{ s r{ c @ sF e Zd ZdZdd� Zddd�Zddd�Zdd d �Zd d � Zd d� Z dS )� _PseudoMatchz: A pseudo match object constructed from a string. c C s || _ || _d S rJ )�_text�_start)r= �startrE r r r" r? s z_PseudoMatch.__init__Nc C s | j S rJ )r� �r= �argr r r" r� s z_PseudoMatch.startc C s | j t| j� S rJ )r� rV r� r� r r r" �end s z_PseudoMatch.endc C s |rt d��| jS )Nz No such group)� IndexErrorr� r� r r r" �group! s z_PseudoMatch.groupc C s | j fS rJ )r� rA r r r" �groups& s z_PseudoMatch.groupsc C s i S rJ r rA r r r" � groupdict) rz z_PseudoMatch.groupdictrJ ) r. r/ r0 r1 r? r� r� r� r� r� r r r r" r s r c s d� fdd� }|S )zL Callback that yields multiple actions for each group in the match. Nc 3 s� � t � �D ]O\}}|d u rqt|�tu r)|�|d �}|r(|�|d �||fV q|�|d �}|d urT|r>|�|d �|_|| t|�|d �|�|�D ]}|rS|V qLq|r^|�� |_d S d S )N� )� enumerater( r r� r� �posr r� )�lexer�match�ctxrv �action�data�item�r~ r r" �callback1 s, � ����zbygroups.<locals>.callbackrJ r )r~ r� r r� r" r - s r c @ rw )�_ThiszX Special singleton used for indicating the caller class. Used by ``using``. Nrx r r r r" r� G s r� c sl i �d�v r �� d�}t|ttf�r|�d< nd|f�d< � tu r+d��fdd� }|S d� ��fdd� }|S ) a� Callback that processes the match with a different lexer. The keyword arguments are forwarded to the lexer, except `state` which is handled separately. `state` specifies the state that the new lexer will start in, and can be an enumerable such as ('root', 'inline', 'string') or a simple string which is assumed to be on top of the root state. Note: For that to work, `_other` must not be an `ExtendedRegexLexer`. �state�stack�rootNc 3 sx � �r�� | j� | jdi ���}n| }|�� }|j|�� fi � ��D ] \}}}|| ||fV q#|r:|�� |_d S d S rj )�updater: r@ r� rK r� r� r� �r� r� r� �lx�srv rM rN )� gt_kwargs�kwargsr r" r� f s � �zusing.<locals>.callbackc 3 sl � �� | j� � di ���}|�� }|j|�� fi ���D ] \}}}|| ||fV q |r4|�� |_d S d S rj )r� r: r� rK r� r� r� r� ��_otherr� r� r r" r� u s � �rJ )�poprC �listr| r )r� r� r� r� r r� r" r P s � r c @ r% )r z� Indicates a state or state action (e.g. #pop) to apply. For example default('#pop') is equivalent to ('', Token, '#pop') Note that state tuples may be used as well. .. versionadded:: 2.0 c C s || _ d S rJ )r� )r= r� r r r" r? � s zdefault.__init__N)r. r/ r0 r1 r? r r r r" r � s r c @ s" e Zd ZdZddd�Zdd� ZdS ) r z� Indicates a list of literal words that is transformed into an optimized regex that matches any of the words. .. versionadded:: 2.0 rq c C s || _ || _|| _d S rJ )r �prefix�suffix)r= r r� r� r r r" r? � s zwords.__init__c C s t | j| j| jd�S )N�r� r� )r r r� r� rA r r r" r; � s z words.getN)rq rq )r. r/ r0 r1 r? r; r r r r" r � s r c @ sJ e Zd ZdZdd� Zdd� Zdd� Zdd � Zdd d �Zd d� Z dd� Z d S )�RegexLexerMetazw Metaclass for RegexLexer, creates the self._tokens attribute from self.tokens on the first instantiation. c C s t |t�r |�� }t�||�jS )zBPreprocess the regular expression component of a token definition.)rC r r; �re�compiler� )r} �regex�rflagsr� r r r" �_process_regex� s z RegexLexerMeta._process_regexc C s& t |�tu st|�sJ d|f ��|S )z5Preprocess the token component of a token definition.z2token type must be simple type or callable, not %r)r( r �callable)r} �tokenr r r" �_process_token� s �z RegexLexerMeta._process_tokenc C s t |t�r/|dkr dS ||v r|fS |dkr|S |dd� dkr)t|dd� � S J d| ��t |t�rbd | j }| jd 7 _g }|D ]}||ksPJ d | ��|�| �|||�� qD|||< |fS t |t�r||D ]}||v sy|d v syJ d | ��qi|S J d| ��)z=Preprocess the state transition action of a token definition.�#pop����#pushN� z#pop:Fzunknown new state %rz_tmp_%dr� zcircular state ref %r)r� r� zunknown new state zunknown new state def %r)rC rQ �intr{ �_tmpname�extend�_process_stater| )r} � new_state� unprocessed� processed� tmp_state�itokens�istater r r" �_process_new_state� s< � �� z!RegexLexerMeta._process_new_statec C s� t |�tu s J d| ��|d dksJ d| ��||v r || S g }||< | j}|| D ]�}t|t�rK||ks>J d| ��|�| �||t|��� q-t|t�rQq-t|t�rk| � |j ||�}|� t � d�jd|f� q-t |�tu swJ d| ��z | �|d ||�}W n ty� } z td |d || | f �| �d} ~ ww | �|d �} t|�d kr�d}n | � |d ||�}|� || |f� q-|S ) z%Preprocess a single state definition.zwrong state name %rr �#zinvalid state name %rzcircular state reference %rrq Nzwrong rule def %rz+uncompilable regex %r in state %r of %r: %sr� � )r( rQ �flagsrC r r� r� ry r r� r� rD r� r� r� r| r� � Exception� ValueErrorr� rV ) r} r� r� r� �tokensr� �tdefr� �rex�errr� r r r" r� � sL � ���� �z RegexLexerMeta._process_stateNc C s< i }| j |< |p | j| }t|�D ] }| �|||� q|S )z-Preprocess a dictionary of token definitions.)� _all_tokensr� r� r� )r} r+ � tokendefsr� r� r r r" �process_tokendef� s z RegexLexerMeta.process_tokendefc C s� i }i }| j D ]_}|j�di �}|�� D ]Q\}}|�|�}|du r;|||< z|�t�}W n ty5 Y qw |||< q|�|d�}|du rFq||||d �< z|�t�} W n ty^ Y qw || ||< qq|S )a Merge tokens from superclasses in MRO order, returning a single tokendef dictionary. Any state that is not defined by a subclass will be inherited automatically. States that *are* defined by subclasses will, by default, override that state in the superclass. If a subclass wishes to inherit definitions from a superclass, it can use the special value "inherit", which will cause the superclass' state definition to be included at that point in the state. r� Nr� )�__mro__�__dict__r; �items�indexr r� r� ) r} r� � inheritable�c�toksr� r� �curitems� inherit_ndx� new_inh_ndxr r r" � get_tokendefs s6 � �� z RegexLexerMeta.get_tokendefsc O sR d| j vr i | _d| _t| d�r| jrn | �d| �� �| _tj | g|�R i |��S )z:Instantiate cls after preprocessing its token definitions.�_tokensr �token_variantsrq ) r� r� r� �hasattrr� r� r� r� r( �__call__)r} r~ �kwdsr r r" r� 8 s zRegexLexerMeta.__call__rJ ) r. r/ r0 r1 r� r� r� r� r� r� r� r r r r" r� � s # , 1r� c @ s$ e Zd ZdZejZi Zddd�ZdS )r z� Base for simple stateful regular expression-based lexers. Simplifies the lexing process so that you need only provide a list of states and regular expressions. �r� c c s� � d}| j }t|�}||d } |D ]�\}}} |||�} | r�|dur:t|�tu r2||| �� fV n|| | �E dH | �� }| dur�t| t�rm| D ]"} | dkrZt|�dkrY|� � qI| dkrf|� |d � qI|� | � qIn+t| t �r�t | �t|�kr�|dd�= n|| d�= n| dkr�|� |d � nJ d| ��||d } n3qz'|| d kr�d g}|d }|t d fV |d7 }W q|t|| fV |d7 }W n ty� Y dS w q) z} Split ``text`` into (tokentype, text) pairs. ``stack`` is the inital stack (default: ``['root']``) r r� r� Nr� r� F�wrong state def: %rrH r� )r� r� r( r r� r� rC r| rV r� rD r� �absr r r� ) r= rE r� r� r� � statestack� statetokens�rexmatchr� r� �mr� r r r" rK i s` � � � �# ��z!RegexLexer.get_tokens_unprocessedN�r� ) r. r/ r0 r1 r� � MULTILINEr� r� rK r r r r" r F s r c @ s" e Zd ZdZddd�Zdd� ZdS )r z9 A helper object that holds lexer position data. Nc C s* || _ || _|p t|�| _|pdg| _d S )Nr� )rE r� rV r� r� )r= rE r� r� r� r r r" r? � s zLexerContext.__init__c C s d| j | j| jf S )NzLexerContext(%r, %r, %r))rE r� r� rA r r r" rB � s �zLexerContext.__repr__�NN)r. r/ r0 r1 r? rB r r r r" r � s r c @ s e Zd ZdZddd�ZdS )r zE A RegexLexer that uses a context object to store its state. Nc c s � | j }|st|d�}|d }n |}||jd }|j} |D ]�\}}}|||j|j�} | r�|durYt|�tu rG|j|| �� fV | �� |_n|| | |�E dH |sY||jd }|dur�t |t �r�|D ]'} | dkrwt |j�dkrv|j� � qd| dkr�|j� |jd � qd|j� | � qdn0t |t�r�t|�t |j�kr�|jdd�= n|j|d�= n|dkr�|j� |jd � nJ d | ��||jd } nHq z;|j|jkr�W dS ||j d kr�dg|_|d }|jtd fV | jd7 _W q |jt||j fV | jd7 _W n t�y Y dS w q ) z Split ``text`` into (tokentype, text) pairs. If ``context`` is given, use this lexer context instead. r r� r� r� Nr� r� Fr� rH )r� r r� rE r� r� r( r r� rC r| rV r� rD r� r� r� r r r� ) r= rE �contextr� r� r� r� r� r� r� r� r r r" rK � sn � �� �# ��z)ExtendedRegexLexer.get_tokens_unprocessedr� )r. r/ r0 r1 rK r r r r" r � s r c c s� � t | �} zt| �\}}W n ty |E dH Y dS w d}d}|D ]{\}}}|du r.|}d} |r�|t|� |kr�|| || � } | rP||| fV |t| �7 }|D ]\} } } || | fV |t| �7 }qR|| } zt| �\}}W n ty{ d}Y n w |r�|t|� |ks:| t|�k r�|||| d� fV |t|�| 7 }q#|r�|p�d}|D ]\}}}|||fV |t|�7 }q�zt| �\}}W n ty� d}Y dS w |s�dS dS )ag Helper for lexers which must combine the results of several sublexers. ``insertions`` is a list of ``(index, itokens)`` pairs. Each ``itokens`` iterable should be inserted at position ``index`` into the token stream given by the ``tokens`` argument. The result is a combined token stream. TODO: clean up the code here. NTr F)�iter�next� StopIterationrV )rt r� r� r� �realpos�insleftrv rM rN �oldi�tmpval�it_index�it_token�it_value�pr r r" rr � s\ � � �� � � �rr c @ r% )�ProfilingRegexLexerMetaz>Metaclass for ProfilingRegexLexer, collects regex timing info.c sL t |t�rt|j|j|jd��n|�t��|��tjf� ���fdd� }|S )Nr� c s` � j d ���fddg�}t�� }��| ||�}t�� }|d d7 < |d || 7 < |S )Nr� r r r� )� _prof_data� setdefault�timer� )rE r� �endpos�info�t0�res�t1�r} �compiledr� r� r r" � match_funcJ s z:ProfilingRegexLexerMeta._process_regex.<locals>.match_func) rC r r r� r� r� r� �sys�maxsize)r} r� r� r� r� r r� r" r� B s � z&ProfilingRegexLexerMeta._process_regexN)r. r/ r0 r1 r� r r r r" r� ? s r� c @ s" e Zd ZdZg ZdZddd�ZdS )�ProfilingRegexLexerzFDrop-in replacement for RegexLexer that does profiling of its regexes.� r� c # s� � � j j�i � t�� ||�E d H � j j�� }tdd� |�� D �� fdd�dd�}tdd� |D ��}t � t d� j j t |�|f � t d � t d d � t d � |D ]}t d | � qSt d � d S )Nc s sP � | ]#\\}}\}}|t |��d ��dd�dd� |d| d| | fV qdS )zu'z\\�\N�A i� )�reprrY rG )�.0r� �r�nrM r r r" � <genexpr>` s � � �z=ProfilingRegexLexer.get_tokens_unprocessed.<locals>.<genexpr>c s | � j S rJ )�_prof_sort_indexr rA r r" r# c s z<ProfilingRegexLexer.get_tokens_unprocessed.<locals>.<lambda>T)�key�reversec s s � | ]}|d V qdS )� Nr )r r! r r r" r e s � z2Profiling result for %s lexing %d chars in %.3f mszn==============================================================================================================z$%-20s %-64s ncalls tottime percall)r� r� zn--------------------------------------------------------------------------------------------------------------z%-20s %-65s %5d %8.4f %8.4f) r@ r� rD r rK r� �sortedr� �sum�printr. rV )r= rE r� �rawdatar� � sum_totalr- r rA r" rK [ s* � � �� z*ProfilingRegexLexer.get_tokens_unprocessedNr� )r. r/ r0 r1 r� r rK r r r r" r� U s r� )3r1 r� r� r� �pip._vendor.pygments.filterr r � pip._vendor.pygments.filtersr �pip._vendor.pygments.tokenr r r r �pip._vendor.pygments.utilr r r r r r � pip._vendor.pygments.regexoptr �__all__rT � staticmethod�_default_analyser( r& r r rQ r ry r r| r{ r r r� r r r r r� r r r rr r� r� r r r r" �<module> sF ' 2 )aH@
| ver. 1.1 | |
.
| PHP 8.4.18 | Ð“ÐµÐ½ÐµÑ€Ð°Ñ†Ð¸Ñ Ñтраницы: 0 |
proxy
|
phpinfo
|
ÐаÑтройка