proposal-regex-escaping - GitLite

KO | EN

gitlite — search

#ai #typescript #go #machine-learning #deep-learning #linux #nodejs #macos #java #windows #cli #kubernetes #vue #pytorch

proposal-regex-escaping

(★ 395)

Proposal for investigating RegExp escaping for the ECMAScript standard

File Explorer

Download Latest Version (.zip)

- - build.yml
  - deploy.yml
- - discussions.md
- - download-files-with-eval-from-npm-10k.js
  - github-search-for-eval-re-100-pages.json
  - github-search-for-eval-regex-100-pages.json
  - github-search-for-eval-regexp-100-pages.json
  - most-dependent-on-10k-npm.json
  - scrape-gh-search.js
  - search-downloaded-files-for-abuser.js
- EscapeRegExpPattern.md
- README.md
.gitignore
.npmrc
EscapedChars.md
LICENSE.txt
package.json
README.md
spec.emu

# Installation Guide

1. Get the code

git clone https://github.com/tc39/proposal-regex-escaping

Downloads the entire project code from GitHub to your computer.

cd proposal-regex-escaping

Moves into the project folder you just downloaded.

2. Node.js

Easy Recommended

Prerequisites

Git Needed to download the project code from GitHub.
Node.js Node.js must be installed to use npm. The LTS version is recommended.

npm install

Downloads and installs the libraries listed in package.json.

npm start

Starts the development/run server.

✅ After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# RegExp Escaping Proposal

This ECMAScript proposal seeks to investigate the problem area of escaping a string for use inside a Regular Expression.

[Formal specification](https://tc39.es/proposal-regex-escaping)

Champions:
 - [@ljharb](https://github.com/ljharb)
 - [@bakkot](https://github.com/bakkot)

## Status

This proposal is a [stage 4 proposal](https://github.com/tc39/proposals).

## Motivation

It is often the case when we want to build a regular expression out of a string without treating special characters from the string as special regular expression tokens. For example, if we want to replace all occurrences of the the string `let text = "Hello."` which we got from the user, we might be tempted to do `ourLongText.replace(new RegExp(text, "g"))`. However, this would match `.` against any character rather than matching it against a dot.

This is commonly-desired functionality, as can be seen from [this years-old es-discuss thread](https://esdiscuss.org/topic/regexp-escape). Standardizing it would be very useful to developers, and avoid subpar implementations they might create that could miss edge cases.

## Chosen solutions:

### `RegExp.escape` function

This would be a `RegExp.escape` static function, such that strings can be escaped in order to be used inside regular expressions:

```js
const str = prompt("Please enter a string");
const escaped = RegExp.escape(str);
const re = new RegExp(escaped, 'g'); // handles reg exp special tokens with the replacement.
console.log(ourLongText.replace(re));
```

Note the double backslashes in the example string contents, which render as a single backslash.
```js
RegExp.escape("The Quick Brown Fox"); // "\\x54he\\x20Quick\\x20Brown\\x20Fox"
RegExp.escape("Buy it. use it. break it. fix it.") // "\\x42uy\\x20it\\.\\x20use\\x20it\\.\\x20break\\x20it\\.\\x20fix\\x20it\\."
RegExp.escape("(*.*)"); // "\\(\\*\\.\\*\\)"
RegExp.escape("｡^･ｪ･^｡") // "｡\\^･ｪ･\\^｡"
RegExp.escape("😊 *_* +_+ ... 👍"); // "😊\\x20\\*_\\*\\x20\\+_\\+\\x20\\.\\.\\.\\x20👍"
RegExp.escape("\\d \\D (?:)"); // "\\\\d\\x20\\\\D\\x20\\(\\?\\x3a\\)"
```

## Cross-cutting concerns

Per https://gist.github.com/bakkot/5a22c8c13ce269f6da46c7f7e56d3c3f, we now escape anything that could possible cause a “context escape”.

> This would be a commitment to only entering/exiting new contexts using whitespace or ASCII punctuators. That seems like it will not be a significant impediment to language evolution.

## Other solutions considered:

### Template tag function

This would be, for example, a template tag function `RegExp.tag`, used to produce a complete regular expression instead of potentially a piece of one:

```js
const str = prompt("Please enter a string");
const re = RegExp.tag`/${str}/g`;
console.log(ourLongText.replace(re));
```

## In other languages

- Perl: [quotemeta(str)](http://perldoc.perl.org/functions/quotemeta.html)
 - PHP: [preg_quote(str)](http://php.net/manual/en/function.preg-quote.php)
 - Python: [re.escape(str)](https://docs.python.org/3/library/re.html#re.escape)
 - Ruby: [Regexp.escape(str)](http://ruby-doc.org/core-2.2.0/Regexp.html#method-c-escape)
 - Java: [Pattern.quote(str)](http://docs.oracle.com/javase/7/docs/api/java/util/regex/Pattern.html#quote(java.lang.String))
 - .NET: [Regex.Escape(str)](https://msdn.microsoft.com/en-us/library/system.text.regularexpressions.regex.escape.aspx)

Note that the languages differ in what they do (e.g. Perl does something different from C#), but they all have the same goal.

We've had [a meeting about this subject](https://github.com/benjamingr/RegExp.escape/blob/master/data/other_languages/discussions.md), whose notes include a more detailed writeup of what other languages do, and the pros and cons thereof.

## FAQ

*   **Why is each escaped character escaped?**

See [https://gist.github.com/bakkot/5a22c8c13ce269f6da46c7f7e56d3c3f].

*   **How is Unicode handled?**

This proposal deals with code points and not code units, so further extensions and dealing with Unicode is done.

*   **What about `RegExp.unescape`?**

While some other languages provide an unescape method we choose to defer discussion about it to a later point, mainly because no evidence of people asking for it has been found (while `RegExp.escape` is commonly asked for).

*   **How does this relate to the EscapeRegExpPattern AO?**

EscapeRegExpPattern (as the name implies) takes a pattern and escapes it so that it can be represented as a string. What `RegExp.escape` does is take a string and escapes it so it can be literally represented as a pattern. The two do not need to share an escaped set and we can't use one for the other. We're discussing renaming EscapeRegExpPattern in the spec in the future to avoid confusion for readers.

*  **Why not `RegExp.tag` or another tagged template based proposal?**

During the first time this proposal was presented - an edge case was brought up where tagged templates were suggested as an alternative. We believe a simple function is a much better and simpler alternative to tagged templates here:
      - Users have consistently been asking for `RegExp.escape` over the past 5 years - both in this repo and elsewhere. Packages providing this functionality are very popular (see [escape-string-regexp](https://www.npmjs.com/package/escape-string-regexp) and [escape-regexp](https://www.npmjs.com/package/escape-regexp)). For comparison there are no downloads and [virtually zero issues or interest](https://github.com/benjamingr/RegExp.tag) when I initiated work on a tag proposal.
      - When interviewing users regarding `RegExp.tag` when trying to get motivating use cases for the API - users spoken with were very confused because of the tagged templates. The feedback was negative enough and they found the API confusing and awkward enough for me to stop pursuing it.
      - Virtually every other programming language offers `.escape` (see "in other languages") and made the trade-off to ship `.escape` even though most of these could have shipped a tagged template API (equivalent, per language).
      - This proposal does not block effort on a tag proposal, the two proposals are not mutually exclusive and both APIs can eventually land.
    See [this issue](https://github.com/tc39/RegExp.escape/issues/45) for discussion.

*   **Why don't you do X?**

If you believe there is a concern that was not addressed yet, please [open an issue](https://github.com/tc39/RexExp.escape/issues).

## Polyfills

- es-shims: [`regexp.escape`](https://www.npmjs.com/package/regexp.escape)
 - [core-js](https://www.npmjs.com/package/core-js)
 - [`@li/regexp-escape-polyfill`](https://jsr.io/@li/regexp-escape-polyfill)