Database-Filler

KO | EN

gitlite — search

#javascript #hacktoberfest #typescript #llm #go #android #rust #deep-learning #linux #docker #macos #nodejs #java #cli

Database-Filler

(★ 9)

MySQL/MariaDB: populate database tables and test schema design by parsing the SQL schema file.

Database-Filler Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

##### This repo is shoved into retirement. The schema file parsing and single-threaded nature of PHP, along with high memory usage makes this package obsolete.

##### More efficient alternatives are [MySQL-Filler](https://github.com/Tinram/MySQL-Filler) and [mysql_random_data_load](https://github.com/Percona-Lab/mysql_random_data_load).

<br>

<hr>

<br>

# Database Filler

#### Populate MySQL database tables with test data by parsing the SQL schema file.

## Purpose

+ Database table population without using any real or sensitive data:
+ Schema design and development:
    + Check table field population with specified datatypes, potential data truncation etc.
    + Test connection encoding and character encoding, and data insertion speeds.

<br>

[1]: https://tinram.github.io/images/databasefiller-data.png
![Database-Filler database][1]

<br>

## Background

Originally, I needed to populate a database containing 14 complex tables. Tools such as Spawner are ideal for populating small tables, but in this case, specifying the datatypes for 300+ fields to initiate Spawner would have been insanity.

Instead, why not parse the SQL schema?

[2]: https://tinram.github.io/images/databasefiller-execute.png
![Database-Filler execute][2]

## Database Requirements

1. The script expects the database schema to already exist in MySQL (`mysql -u root -p < test.sql`).
2. **All table names** and **column names** in the MySQL schema **require back-ticks**.
3. **Unique keys must be removed** from tables when the configuration array option *random_data* is set to false.

## Other

+ The majority of MySQL datatypes are supported.
+ Any foreign keys are disabled on data population.
+ Random character generation is slow in PHP, and such slowness further depends on field length, number of fields, and the number of rows being generated.
+ Multiple INSERTs are added in a single query, which is quite fast. The number of INSERTs per second will depend on MySQL configuration settings (the defaults are not optimised), datatype / length inserted, system load, operating system, hardware etc.

## Further Options

Configuration boolean toggles (`false` by default):

+ *incremental_ints*
    + make added integers incremental, enabling simplistic integer foreign keys.
+ *populate_primary_key*
    + populate a primary key field, e.g. a UUID used as a primary key (experimental, supports only some definitions).

## Set-up

Ensure the database already exists in MySQL  
e.g. for the test schema:

```bash
    mysql -u root -p < test.sql
```

Adjust the array connection details and parameters in the file *databasefiller_example.php*

Then execute this file with PHP on the command-line:

```bash
    php databasefiller_example.php
```

*or* run the file through a web server e.g.

http://localhost/Database-Filler/databasefiller_example.php

## Other Projects

+ [SQLParser](https://github.com/iamcal/SQLParser)
+ [schema-parser-mysql](https://github.com/ekhaled/schema-parser-mysql/)
+ [MySQL_Filler](https://github.com/Tinram/MySQL_Filler)

*SQLParser* would have been used in this project had it been available in 2014.

## License

Database Filler is released under the [GPL v.3](https://www.gnu.org/licenses/gpl-3.0.html).

Database-Filler

Database-Filler Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Database-Filler

Database-Filler Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README