Takayuki Miyauchi

DigitalCube Inc.

<p>The Advanced CSV Importer will import the following content from a CSV file.</p>
<p>Advanced CSV Importer is fully unit-tested. The plugin is stable and ready to be used in large projects like enterprise applications.</p>
<ul>
<li>Posts, pages and other custom post types</li>
<li>Custom fields and post meta</li>
<li>Categories, tags</li>
</ul>
<p>https://github.com/miya0001/advanced-csv-importer</p>
<p>This plugin requires PHP 5.3 or later.</p>
<h4>Default CSV field names</h4>
<ul>
<li>ID</li>
<li>post_content</li>
<li>post_name</li>
<li>post_title</li>
<li>post_status</li>
<li>post_type</li>
<li>post_author</li>
<li>ping_status</li>
<li>post_parent</li>
<li>menu_order</li>
<li>to_ping</li>
<li>pinged</li>
<li>post_password</li>
<li>guid</li>
<li>post_content_filtered</li>
<li>post_excerpt</li>
<li>post_date</li>
<li>post_date_gmt</li>
<li>comment_status</li>
<li>post_category</li>
<li>tags_input</li>
<li>page_template</li>
</ul>
<p>You can change field name via <code>acsv_post_object_keys</code> hook like following.</p>
<pre><code>add_filter( 'acsv_post_object_keys', function( $post_object_keys ){
    $post_object_keys['title'] = 'post_title';
    $post_object_keys['content'] = 'post_content';
    return $post_object_keys;
} );
</code></pre>
<p>Other columns will be saved to the custom field.</p>
<p>There is a sample of the CSV.</p>
<p><style>.gist table { margin-bottom: 0; }</style>
<div style="tab-size: 8" id="gist17649185" class="gist">
<div class="gist-file" translate="no" data-color-mode="light" data-light-theme="light">
<div class="gist-data">
<div class="js-gist-file-update-container js-task-list-container">
<div id="file-test-csv" class="file my-2">
<div itemprop="text"
      class="Box-body p-0 blob-wrapper data type-csv  "
      style="overflow: auto" tabindex="0" role="region"
      aria-label="test.csv content, created by miya0001 on 06:51PM on December 27, 2014."
    ></p>
<div class="blob-interaction-bar">
  <svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-search">
    <path d="M10.68 11.74a6 6 0 0 1-7.922-8.982 6 6 0 0 1 8.982 7.922l3.04 3.04a.749.749 0 0 1-.326 1.275.749.749 0 0 1-.734-.215ZM11.5 7a4.499 4.499 0 1 0-8.997 0A4.499 4.499 0 0 0 11.5 7Z"></path>
</svg><br />
  <input type="text" name="filter" class="form-control js-csv-filter-field blob-filter" autocapitalize="off"
         placeholder="Search this file…" aria-label="Search this file…">
</div>
<div class="markdown-body js-check-hidden-unicode" data-line-alert="before" data-hpc>
    <template class="js-file-alert-template"></p>
<div data-view-component="true" class="flash flash-warn flash-full d-flex flex-items-center">
  <svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
    <path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg><br />
    <span><br />
      This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.<br />
      <a class="Link--inTextBlock" href="https://github.co/hiddenchars" target="_blank" rel="nofollow ugc">Learn more about bidirectional Unicode characters</a><br />
    </span></p>
<div data-view-component="true" class="flash-action">        <a href="{{ revealButtonHref }}" data-view-component="true" class="btn-sm btn" rel="nofollow ugc">    Show hidden characters<br />
</a>
</div>
</div>
<p></template><br />
<template class="js-line-alert-template"><br />
  <span aria-label="This line has hidden Unicode characters" data-view-component="true" class="line-alert tooltipped tooltipped-e"><br />
    <svg aria-hidden="true" height="16" viewBox="0 0 16 16" version="1.1" width="16" data-view-component="true" class="octicon octicon-alert">
    <path d="M6.457 1.047c.659-1.234 2.427-1.234 3.086 0l6.082 11.378A1.75 1.75 0 0 1 14.082 15H1.918a1.75 1.75 0 0 1-1.543-2.575Zm1.763.707a.25.25 0 0 0-.44 0L1.698 13.132a.25.25 0 0 0 .22.368h12.164a.25.25 0 0 0 .22-.368Zm.53 3.996v2.5a.75.75 0 0 1-1.5 0v-2.5a.75.75 0 0 1 1.5 0ZM9 11a1 1 0 1 1-2 0 1 1 0 0 1 2 0Z"></path>
</svg><br />
</span></template></p>
<table class="js-csv-data csv-data js-file-line-container">
<thead>
<tr id="file-test-csv-LC1" class="js-file-line">
<td id="file-test-csv-L1" class="blob-num js-line-number" data-line-number="1"></td>
<th>ID</th>
<th>post_name</th>
<th>post_author</th>
<th>post_date</th>
<th>post_type</th>
<th>post_status</th>
<th>post_title</th>
<th>post_content</th>
<th>post_category</th>
<th>tags_input</th>
<th>custom_field</th>
</tr>
</thead>
<tbody>
<tr id="file-test-csv-LC2" class="js-file-line">
<td id="file-test-csv-L2" class="blob-num js-line-number" data-line-number="2"></td>
<td></td>
<td>Import-test</td>
<td>admin</td>
<td>2013/9/13 0:00</td>
<td>post</td>
<td>publish</td>
<td>CSV Import Test</td>
<td>This is a post for csv import.<br />
Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua.<br />
Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.</td>
<td>fruits</td>
<td>apple,banana</td>
<td>this is custom field value.</td>
</tr>
<tr id="file-test-csv-LC3" class="js-file-line">
<td id="file-test-csv-L3" class="blob-num js-line-number" data-line-number="3"></td>
<td></td>
<td></td>
<td>editor</td>
<td></td>
<td>post</td>
<td>publish</td>
<td>define author test</td>
<td></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr id="file-test-csv-LC4" class="js-file-line">
<td id="file-test-csv-L4" class="blob-num js-line-number" data-line-number="4"></td>
<td></td>
<td></td>
<td>2</td>
<td></td>
<td>post</td>
<td></td>
<td>define author id test</td>
<td></td>
<td></td>
<td></td>
<td></td>
</tr>
<tr id="file-test-csv-LC5" class="js-file-line">
<td id="file-test-csv-L5" class="blob-num js-line-number" data-line-number="5"></td>
<td>1</td>
<td>Hello-world-updated</td>
<td></td>
<td></td>
<td>post</td>
<td></td>
<td>Hello world! Updated!</td>
<td>Welcome to WordPress. This is your first post. Updated by RS CSV Importer!</td>
<td></td>
<td></td>
<td></td>
</tr>
</tbody>
</table></div>
</p></div>
</p></div>
</div></div>
<div class="gist-meta">
        <a href="https://gist.github.com/miya0001/06f1a8e2bf1789c7ddee/raw/3c95de96302f556e58049e550f9a14b047048dbe/test.csv" style="float:right" class="Link--inTextBlock" rel="nofollow ugc">view raw</a><br />
        <a href="https://gist.github.com/miya0001/06f1a8e2bf1789c7ddee#file-test-csv" class="Link--inTextBlock" rel="nofollow ugc"><br />
          test.csv<br />
        </a><br />
        hosted with ❤ by <a class="Link--inTextBlock" href="https://github.com" rel="nofollow ugc">GitHub</a>
      </div>
</p></div>
</div>
<h4>Action Hooks</h4>
<ul>
<li>acsv_after_insert_post</li>
</ul>
<h4>Filter Hooks</h4>
<ul>
<li>acsv_post_object_keys</li>
<li>acsv_post_defaults</li>
<li>acsv_import_upload_size_limit</li>
<li>acsv_pre_get_post_objects</li>
<li>acsv_after_get_post_objects</li>
<li>acsv_csv_format</li>
<li>acsv_csv_to_hash_array</li>
<li>acsv_get_user_by_field</li>
</ul>
<h4>WP-CLI</h4>
<p>Importing:</p>
<pre><code>$ wp csv import tests/_data/wp/sample.csv
+------+-----------------------+------+---------+------------+---------------------+
| ID   | Title                 | Type | Status  | Author     | Date                |
+------+-----------------------+------+---------+------------+---------------------+
| 1720 | CSV Import Test       | post | publish | admin      | 2013-09-13 00:00:00 |
| 1721 | define author test    | post | publish | admin      | 2014-12-27 18:44:46 |
| 1722 | define author id test | post | publish | themedemos | 2014-12-27 18:44:46 |
| 1    | Hello world! Updated! | post | publish | admin      | 2014-12-27 18:44:46 |
+------+-----------------------+------+---------+------------+---------------------+
</code></pre>
<p>History:</p>
<pre><code>$ wp csv log
+----------+-----------------------------+---------------------+---------+---------+
| ID       | Title                       | Date                | Success | Failure |
+----------+-----------------------------+---------------------+---------+---------+
| e0a66344 | Imported from WP-CLI.       | 2014-12-27 18:44:46 |       4 |       0 |
| 43c47af6 | Imported from admin screen. | 2014-12-27 16:53:17 |       4 |       0 |
| df0f140b | Imported from WP-CLI.       | 2014-12-27 16:21:42 |       4 |       0 |
+----------+-----------------------------+---------------------+---------+---------+
</code></pre>
<p>Details of the history:</p>
<pre><code>$ wp csv log e0a66344
+------+-----------------------+------+---------+------------+---------------------+
| ID   | Title                 | Type | Status  | Author     | Date                |
+------+-----------------------+------+---------+------------+---------------------+
| 1720 | CSV Import Test       | post | publish | admin      | 2013-09-13 00:00:00 |
| 1721 | define author test    | post | publish | admin      | 2014-12-27 18:44:46 |
| 1722 | define author id test | post | publish | themedemos | 2014-12-27 18:44:46 |
| 1    | Hello world! Updated! | post | publish | admin      | 2014-12-27 18:44:46 |
+------+-----------------------+------+---------+------------+---------------------+
</code></pre>


Advanced CSV Importer

Import posts, pages, custom fields, categories, tags and more from a CSV file.

OllieJones

rjasdfiii

<h4>How do I use this plugin?</h4>
<p>After you install and activate this plugin, visit the Index MySQL Tool under the Tools menu. From there you can press the <em>Add Keys Now</em> button. If you have large tables, use it with <a href="https://wp-cli.org/" rel="nofollow ugc">WP-CLI</a> instead to avoid timeouts. See the WP-CLI section to learn more.</p>
<h4>What does it do for my site?</h4>
<p>This plugin works to make your MySQL database work more efficiently by adding high-performance keys to the tables you choose. On request it monitors your site’s use of your MySQL database to detect which database operations are slowest. It is most useful for large sites: sites with many users, posts, pages, and / or products.</p>
<p>You can use it to restore WordPress’s default keys if need be.</p>
<h4>What is this all about?</h4>
<p>Where does WordPress store all that stuff that makes your site great? Where are your pages, posts, products, media, users, custom fields, metadata, and all your valuable content? All that data is in the <a href="https://www.mysql.com/" rel="nofollow ugc">MySQL</a> relational database management system. (Many hosting providers and servers use the <a href="https://mariadb.org/" rel="nofollow ugc">MariaDB</a> fork of the MySQL software; it works exactly the same way as MySQL itself.)</p>
<p>As your site grows, your MySQL tables grow. Giant tables can make your page loads slow down, frustrate your users, and even hurt your search-engine rankings. And, bulk imports can take absurd amounts of time. What can you do about this?</p>
<p>You can install and use a database cleaner plugin to get rid of old unwanted data and reorganize your tables. That makes them smaller, and therefore faster. That is a good and necessary task. That is not the task of this plugin. You can, if your hosting provider supports it, install and use a <a href="https://developer.wordpress.org/reference/classes/wp_object_cache/#persistent-cache-plugins" rel="nofollow ugc">Persistent Object Cache plugin</a> to reduce traffic to your database. That is not the task of this plugin either.</p>
<p>This plugin adds database <a href="https://dev.mysql.com/doc/refman/8.0/en/mysql-indexes.html" rel="nofollow ugc">keys</a> (also called indexes) to your MySQL tables to make it easier for WordPress to find the information it needs. All relational database management systems store your information in long-lived <em>tables</em>. For example, WordPress stores your posts and other content in a table called <em>wp_posts</em>, and custom post fields in another table called <em>wp_postmeta</em>.  A successful site can have thousands of posts and hundreds of thousands of custom post fields. MySQL has two jobs:</p>
<ol>
<li>Keep all that data organized.</li>
<li>Find the data it needs quickly.</li>
</ol>
<p>To do its second job, MySQL uses database keys. Each table has one or more keys. For example, <code>wp_posts</code> has a key to let it quickly find posts when you know the author. Without its <em>post_author</em> key MySQL would have to scan every one of your posts looking for matches to the author you want. Our users know what that looks like: slow. With the key, MySQL can jump right to the matching posts.</p>
<p>In a new WordPress site with a couple of users and a dozen posts, the keys don’t matter very much. As the site grows the keys start to matter, a lot. Database management systems are designed to have their keys updated, adjusted, and tweaked as their tables grow. They’re designed to allow the keys to evolve without changing the content of the underlying tables. In organizations with large databases adding, dropping, or altering keys doesn’t change the underlying data. It is a routine maintenance task in many data centers. If changing keys caused databases to lose data, the MySQL and MariaDB developers would hear howling not just from you and me, but from many heavyweight users. (You should still back up your WordPress instance of course.)</p>
<p>Better keys allow WordPress’s code to run faster <em>without any code changes</em>.  Experience with large sites shows that many MySQL slowdowns can be improved by better keys. Code is poetry, data is treasure, and database keys are grease that makes code and data work together smoothly.</p>
<h4>Which tables does the plugin add keys to?</h4>
<p>This plugin adds and updates keys in these WordPress and WooCommerce tables.</p>
<ul>
<li>wp_comments</li>
<li>wp_commentmeta</li>
<li>wp_posts</li>
<li>wp_postmeta</li>
<li>wp_termmeta</li>
<li>wp_users</li>
<li>wp_usermeta</li>
<li>wp_options</li>
<li>wp_wc_orders_meta</li>
<li>wp_woocommerce_order_itemmeta</li>
<li>wp_automatewoo_log_meta</li>
</ul>
<p>You only need run this plugin once to get its benefits.</p>
<h4>How can I monitor my database’s operation?</h4>
<p>On the Index MySQL page (from your Tools menu on your dashboard), you will find the “Monitor Database Operations” tab. Use it to request monitoring for a number of minutes you choose.</p>
<p>You can monitor</p>
<ul>
<li>either the site (your user-visible pages) or the dashboard, or both.</li>
<li>all pageviews, or a random sample. (Random samples are useful on very busy sites to reduce monitoring overhead.)</li>
</ul>
<p>Once you have gathered monitoring information, you can view the captured queries, and sort them by how long they take. Or you can save the monitor information to a file and show it to somebody who knows about database operations. Or you can upload the monitor to the plugin’s servers so the authors can look at it.</p>
<p>It’s a good idea to monitor for a five-minute interval at a time of day when your site is busy. Once you’ve completed a monitor, you can examine it to determine which database operations are slowing you down the most.</p>
<p>Please consider uploading your saved monitors to the plugin’s servers. It’s how we learn from your experience to keep improving. Push the Upload button on the monitor’s tab.</p>
<h4>WP-CLI command line operation</h4>
<p>This plugin supports <a href="https://wp-cli.org/" rel="nofollow ugc">WP-CLI</a>.  When your tables are large this is the best way to add the high-performance keys: it doesn’t time out.</p>
<p>Give the command <code>wp help index-mysql</code> for details. A few examples:</p>
<ul>
<li><code>wp index-mysql status</code> shows the current status of high-performance keys.</li>
<li><code>wp index-mysql enable --all</code> adds the high-performance keys to all tables that don’t have them.</li>
<li><code>wp index-mysql enable wp_postmeta</code> adds the high-performance keys to the postmeta table.</li>
<li><code>wp index-mysql disable --all</code> removes the high-performance keys from all tables that have them, restoring WordPress’s default keys.</li>
<li><code>wp index-mysql enable --all --dryrun</code> writes out the SQL statements necessary to add the high-performance keys to all tables, but does not run them.</li>
<li><code>wp index-mysql enable --all --dryrun | wp db query</code> writes out the SQL statements and pipes them to wp db to run them.</li>
</ul>
<p>Note: avoid saving the –dryrun output statements to run later. The plugin generates them to match the current state of your tables.</p>
<h4>Why use this plugin?</h4>
<p>Three reasons (maybe four):</p>
<ol>
<li>to save carbon footprint.</li>
<li>to save carbon footprint.</li>
<li>to save carbon footprint.</li>
<li>to save people time.</li>
</ol>
<p>Seriously, the microwatt hours of electricity saved by faster web site technologies add up fast, especially at WordPress’s global scale.</p>
<h4>How can I learn more about making my WordPress site more efficient?</h4>
<p>We offer several plugins to help with your site’s database efficiency. You can <a href="https://www.plumislandmedia.net/wordpress/performance/optimizing-wordpress-database-servers/" rel="nofollow ugc">read about them here</a>.</p>
<h4>Credits</h4>
<ul>
<li>Michael Uno for Admin Page Framework.</li>
<li>Marco Cesarato for LiteSQLParser.</li>
<li>Allan Jardine for Datatables.net.</li>
<li>Leho Kraav and Sebastian Sommer for suggesting the WooCommerce tables.</li>
<li>Japreet Sethi for advice, and for testing on his large installation.</li>
<li>Rick James for everything.</li>
<li>Jetbrains for their IDE tools, especially PhpStorm. It’s hard to imagine trying to navigate an epic code base without their tools.</li>
</ul>


Index WP MySQL For Speed

Thanks for this wonderful, simple, effective and powerful plugin!

It made one of our queries 133 times faster. What a joy.

Made one of our queries 133 times faster!

This is absolutely fantastic work. I've reviewed your discussions on WP issue tracker and various other places and came to the same conclusion. While I had already added some of my own custom indexes long ago, this is even better. Amazing job!

Fantastic

Wow. Fantastic plugin! I am using the CLI to do the optimization, and within 30 seconds, all the problems with slow queries are gone! This plugin is a must-have if you have large database. :)

Fantastic plugins


I can't understand how Wordpress doesn't natively bring these indexes that speed up performance so much. Thanks to the author for this plugin.


Indexing wp should have


Great, great plugin!



Thank you for this masterpiece of software. I've optimized client's databases in seconds, changed table formats to InnoDB in seconds, and added indexes to million chains tables in minutes.



Thanks!



¡Gracias!


1.5 GB Database optimized in minutes

It's great to see a plugin like this created and maintained to such a high standard. Thank you Ollie

Top class


My WordPress-powered sites aren't popular and don't have a lot of posts yet. Still, I noticed a difference in speed immediately.


Impressive


We've used this plugin on a few busy woocommerce websites and the result is amazing.



MySQL cpu usage and response times drop dramatically. Especially if used with object cache.



Thanks again!


Amazing Results

Speed up your WordPress site by adding high-performance keys (database indexes) to your MariaDB / MySQL database tables.

Advanced CSV Importer vs Index WP MySQL For Speed