DoccoLabs Blog: cliptable

Showing posts with label cliptable. Show all posts

Wednesday, November 11, 2015

How ClipTable works?

A few days ago I was approached by someone at work, who got some files needed to be exported into one of our SQL Servers.
The file format wasn't very intuitive, and caused this coworker a lot of different errors trying to use the "Import and Export Wizard". (Which is a basic SSIS task behind the scene)

Anyway, after being asked to "give it a shot", I naturally went to ClipTable, and of course, got this done in less than 2 minutes.

So this coworker asked me how this was done so fast, and what he was doing wrong.
I've explained that I was using a different tool. (and explained a bit about ClipTable)

"Yeah, but how was ClipTable able to determine how to turn the file into a table without any configuration?" she asked.

So, I answered and decided to write this post about some behind-the-scene ClipTable techniques.

If you're new to the tool -
ClipTable is a very fast SQL Import tool, which allows you to turn almost any tabular data into a SQL Server/Oracle/MySQL/PostgreSQL/Firebird Table.

Here is a behind-the-scenes glimpse to ClipTable's engine (that could) and some of the things it's able to do:

View image | gettyimages.com

So, when you import from memory (clipboard) or file, here is a partly list of what's happening:

[The engine analyzes the data, answering the following questions]

Is this an XML string?

Can this turn into a 2-d table?

Is this a JSON data?

Is this a serial JSON data? (repeated columns)
Which parts of the data can turn into a 2-d table?

Is this a textual data?

Does the data seem valid?
Analyzing the string pattern,
what is most likely to be the column/row delimiters?
Does the data include headers?
Are there white-spaces to be removed?

Are there any duplicate field names?
What is the best Data Type for each column?
What's the fastest method to write the table into the destination server?

Does this server support Bulk Copy/Insert?
Can insert statement sent in a big batch?

These engine features help ClipTable turning this:

Into this:

In just a few seconds.

Wednesday, November 4, 2015

SQL ClipTable now offers better JSON handling and SQL Server 2016 support

There's a new version of SQL ClipTable released today, which has multiple engine updates as well as two important features:

SQL Server 2016 support (tested against CTP's, will make sure RTM is fully supported upon release)
JSON format support has been extended to support a 'serial' JSON file, which is basically a file on which each line represents a new JSON-based row, with a similar schema.

As a reminder, ClipTable lets you import almost any data, of any shape and form into your database. Supporting all major relational database engines available today, including SQL Server, Oracle, MySQL, PostgreSQL, FireBird and more.

Want to see the extended JSON support in action?

Here's an example for such a file: Try Copy the code below & Paste into ClipTable

Monday, October 20, 2014

Turn JSON into a SQL Table

One of the new features introduced in the latest version of ClipTable is the ability to parse (most) JSON data (as long as it can be converted to tabular format).

While ClipTable's main purpose is to turn any textual data into a SQL Table (either from your clipboard or a flat file) - we've made two 'other' formats it can read. The first was xml, and now, quite naturally - JSON.

Want to see how it works? Here's a quick example:

Run ClipTable

Copy this following (JSON) text to your clipboard:

[
 {
  color: "red",
  value: "#f00"
 },
 {
  color: "green",
  value: "#0f0"
 },
 {
  color: "blue",
  value: "#00f"
 },
 {
  color: "cyan",
  value: "#0ff"
 },
 {
  color: "magenta",
  value: "#f0f"
 },
 {
  color: "yellow",
  value: "#ff0"
 },
 {
  color: "black",
  value: "#000"
 }
]

Now, Paste!

You should be getting this:

And if you don't know ClipTable yet - the distance between this point to actually having a SQL Table with the above data is about two clicks away.

Feel free to try, and challenge with other tabular clipboard content.

ClipTable - Data import made easy! (Real easy!)

Tuesday, September 9, 2014

Your new data Import-Export power tools

If you’re working with databases, you are obviously no stranger to the endless need for getting data in and out the database. And not only the traditional inserts and selects, but rather importing from/exporting to “foreign” sources.

Two of our tools are just around that area and can pretty much solve any scenario of import/export you may come across!

How?

Well, the first tool, SqlTableZip can export a data from any query (table, stored procedure execution result, free t-sql) into a compressed file - Which includes the query text, headers, field types, and of course, the data - highly compressed!

This (.sqz) file, can be moved around and restored anywhere. Supporting multiple SQL Server versions, including Azure (so in fact, it is also a very easy way to get data in & out between Azure and local SQL Instances)

DBA’s sending production-data to developers (who don’t have access), Field engineers bringing offline data for analysis/support purposes, or even a simple table-level backup -- these are all valid scenarios that SqlTableZip can take care of; easily, quickly and with zero-hassle.

There are no size limits. You can backup huge amount of data and everything runs super-fast.

So, getting data in & out of SQL Server is covered, but what about data some comes from foreign sources?

If your source is a table coming from anything like html formatted tables, xml, excel, pdf, word and pretty much any other tabular format that needs to be turned into a relational-database table: ClipTable is here to help!

Instead of supporting each of the formats above (and many more) - we took a different approach by building a smart algorithm that can analyze the content you copy into your clipboard.

So the process becomes very simple - you select the desired content, paste it into ClipTable and get a new table ready to be created.

ClipTable will determine the correct format, the best field data types, column names and the correct row/col delimiters. All of these are automatically done and all that is left for you, the user, is to decide where you would like the new table to be created.

As a bonus - ClipTable supports most of the popular relational databases out there today - so you can create your new table/s in SQL Server, Oracle, MySQL, PostgreSQL and Firebird.

So, to summarize: if data import/export is part of your routine, this is definitely worth trying.
To learn more and of course get the software, visit our website @ www.doccolabs.com

Tuesday, September 2, 2014

ClipTable to support Firebird Database

Calling out all Firebird Database users!

ClipTable, our revolutionary *anything* to SQL Table importer, is now offering Firebird support!

What does this mean?

If you are new to ClipTable, this is a robust application which lets you copy any tabular data to your clipboard (yes, Ctrl-C) and paste it into ClipTable, which analyzes the input and creates an optimal SQL Table with all the data.
This replaces the need to manually modify the data in order to insert it into a table.
ClipTable engine can detect the most suitable data-types, sizes, headers, delimiters and everything else involved in the table creation.
Firebird support now joins the existing SQL Server, Oracle, MySQL and PostgreSQL which are currently supported.

What's required?

In order to work with Firebird, you'll need to install Firebird's ODBC drivers from this link: http://www.firebirdsql.org/en/odbc-driver/
Also - ClipTable runs on Windows and required .Net framework 4.5 (included in Windows Update, but just in case - http://www.microsoft.com/en-us/download/details.aspx?id=30653)

Known Issues

There are currently not known issues reported. If you encounter one, please contact us at support@doccolabs.com

Get the latest version here - http://doccolabs.com/products/cliptable

Monday, August 25, 2014

ClipTable on Steroids!

A new version of ClipTable was released earlier today and among other changes it contains a very important improvement - The clipboard/file parsing engine is now 10x Times Faster (!)

This, along with the native 64 bit support, now enables you to import large objects, of any kind into your SQL Server.

For those of you who are still not familiar with ClipTable - It is an application that lets you copy any tabular data from any application (for example - Word, Excel, Acrobat, web sites and more) and turn it into an optimized SQL Table in seconds!
There is no need to deal with field types, sizes, delimiter or any other hassle along the way.

You can download, learn more and get to know our other products at www.doccolabs.com

Monday, June 30, 2014

Announcing - products are out of beta, available for purchase.

After a lot of hard work, the beta 'incubation' period is finally over.
We are excited to announce new & exciting versions for all of our products!

The products available for purchase are:

ClipTable (Turn *any* tabular data, from any source to a SQL Table in seconds!)
Database File Explorer (Get a clear picture of how your databases consume your storage space)
SQL Table Zip (Our new query-to-go packer - turn any table or SQL Query into a compressed [.sqz] file)
Log Table Viewer (Add logging to your stored procedures, along with a powerful real-time viewer)
And as always - SQL Stripes, which is on sale for a limited time: $799 (instead of $1,250)

Each product can be purchased separately, or as a bundle - in a new attractive offer. (see more details at doccolabs.com/purchase)

We are also pleased to present our redesigned website, hope you all like it.

Thursday, June 27, 2013

New Releases - and a personal note

Hi There,

Today, new versions of ClipTable, dbFileExplorer & LogTableViewer were released to the public (that's you)

Changes include:
ClipTable -
- Fixed support for identity column on PostgreSQL (SERIAL)
- Repository enhancements

dbFileExplorer -
- Added Extended Database Properties
- Some minor bugs were fixed

Log Table Viewer -
- Engine updated

Shared Repository (applies to all of the above)
- Added multiple selection support (wide)
- Fixed double-click on non-server

You can get them all from our website! all free, no exceptions.

Now, on to the personal note.

First, I would like to thank everyone for the continuous feedback. It helps me making the products better and makes you enjoy the results :)

Please continue sharing your thoughts about each one of our products. I personally read each and every one of your feedback.

Second, In the very near future, I will be moving to Seattle WA (which is a very long journey for me).

During this period, I might not be as reachable as always, but I promise this is only for a temporary period - so if you send feedback and get no response for a while, wait a bit longer :)

All The Best,

Adi

www.doccolabs.com

Tuesday, May 28, 2013

New Releases!

I don't always blog about new versions, but today I do - because there are 3 new versions released today!

Here's what's new:
ClipTable:
- Repository instant groups by version has been fixed
- Advanced options now allow you to view ClipTable's main parsing engine messages
- UI enhancements
- v1.0.3.9 Released

Database File Explorer:
- Extended table properties: Estimated row size, index drill-down from column and more...
- On Database-based view, each drive (used by the database) will not also show the exact database size on that drive
- Better size unit display (kb/mb/gb/tb) - everywhere
- Animated indicator icon on TreeView when loading special analysis data
- Repository: Fixed some stability issues
- Repository: Fixed instant-grouping by version, added # of servers icon for each version
- UI enhancements
v1.0.3.0 released

Log Table Viewer
- Added support for auto server load (from repository)
- Server info changed to DoccoLabs standard server window
- Maximum log file size modified to 2mb
- Repository: Fixed instant-grouping by version, added # of servers icon for each version
v2.0.2.0 Released

Get it all here: http://www.doccolabs.com
If you already have it installed, you'll get a message allowing you to upgrade automatically.

Enjoy and as always - share your feedback.

Cheers,
Adi

Wednesday, April 24, 2013

Table import - made even easier! Announcing Drag & Drop table importer.

Hi,
So as you probably already know, ClipTable's main concept is to copy any tabular text, from anywhere, into the clipboard and immediately turn it into a SQL Table.

Besides Clipboard data, ClipTable also supports direct-file import, accessible through the Import extra options (see screenshot):

And today, we're announcing a 3rd option, which speeds up the process even more -
The new version allows an easy Drag&Drop of any data into ClipTable, turning it into a SQL Table in no-time!
Here's how:

Run ClipTable, and choose the "Import Data" tab.
Now, select any tabular data from any source and drag it into ClipTable.
Here's the data we've used for sample:

Drag & Drop

That's it! the table is ready to be created on any of your databases.

Enjoy the new feature and as always - send us feedbacks.

And always remember -

ClipTable simplifies the way you import data from *any* source into your SQL Database.

Thursday, February 14, 2013

64-bit version for ClipTable is now available

For those of you working with 64-bit OS and would like to use the full cpu/memory power for ClipTable's heavy(er) actions - you're invited to try our new ClipTable x64.

We've come to realize that many of our users already use a 64-bit desktop environment, so while the regular 32-bit version works just fine.
ClipTable may require a lot of RAM when using large clipboard/file resources - hence the 64bit, letting you use all of your available system resources.

Get the new 64-bit version here:
http://www.doccolabs.com/products_cliptable.html

+SQL Server solutions by Docco Labs

Tuesday, October 16, 2012

Triple release day!

3 Updates are being released today, for ClipTable, Database File-Explorer & Log-table Viewer

Here's the change-log:

ClipTable:
- BCP (insert) mode is now available! ClipTable can generate a BCP IN statement of any CSV file
- Added an option to turn any column into a string (after clipboard import is done)
- Data in grid can automatically extend on edit
- Better white-spaces handling on string analysis
- Improved XML detection
- SQL Text highlight feature implemented
- Multiple UI improvements
- v1.0.3.2 Released

Database File-Explorer:
- Log file is now being recycled when over a configured size (currently 10mb)
- Added ChangeLog (inside the About Window)
- Core classes updated
- SQL Text highlight feature implemented
- Shared Repository:
- Added SQL Profiler integration
- If multiple versions are installed, SSMS/Profiler will launch at the newest version
- Multiple UI improvements
v1.0.2.3 released

LogTableViewer:
- Main Engine updated
- SQL Text highlight feature implemented
- Multiple UI improvements
v2.0.1.6 Released

Shared Repository: (which means, all of the above)
- Added SQL Profiler integration
- If multiple versions are installed, SSMS/Profiler will launch at the newest version
- Multiple UI improvements

Download all for free:

http://www.doccolabs.com/products.html

Wednesday, October 3, 2012

(ClipTable) INSERT solutions

Hey ClipTable users!

As a user, you probably already know how ClipTable can quickly turn any data into a SQL Table.
The main-stream option would be:
- Copying a tabular data into your clipboard
- Pressing the magical "Import" button
- Defining a destination server
- Execute!

But there is more to it; Today I'm going to cover some other INSERT options ClipTable supports

For the demo I'm going to use a simple query against AdventureWorksLT2008:
select * from AdventureWorksLT2008.SalesLT.CustomerAddress
I'm taking the result and saving it as a CSV file, and also copying the result into the clipboard.

The first one is the "Generate INSERT Statement" option; which, instead of pumping the data into the table, creates an insert script you can launch anywhere.
Here's how you use it:

Copying the above query data into the clipboard, I click "Import from Clipboard", and the query data now appears in ClipTable (see screenshot):

Next, I'm going to jump right to the "Setup & Go" tab, but instead of clicking "Execute", I'm going to click the other part of the button, which contains additional insertion options (see screenshot):

Now, select the "Generate INSERT statements only", and the following window appears:

From this point, simply copy the data and execute anywhere you want.
Easy, isn't it?

Now let's move on to the other option: BULK INSERT.
On this option, you let ClipTable perform a field analysis on a CSV file, and then creating a complete BULK INSERT statement to load this file into a table, without having ClipTable to read the entire content into the memory first.
Needless to say, this feature is not 100% bullet-proof due to some known differences with BULK INSERT behavior as well as the fact that the default option is to not analyzing to entire file (speed & memory considerations), so field types may need some additional tune-ups.

OK, Let's go back to the "Import Clipboard Data" tab, only this time, we'll select the "Import from File" option (see screenshot):

Now, let's choose the CSV we've prepared earlier.
Before doing so, as a preparation for the bulk insert, there are two options we're going to change:
1. Make sure "Treat NULL strings as DbNull" option is unchecked
2. Uncheck "Data contains Headers" (since the CSV file does not contain headers on the 1st line)
(see screenshot):

Now, let's jump to the "Setup & Go" tab again and choose the "Generate BULK INSERT" option.
The following window appears:

Again, you can now use this data from your Management Studio (or equivalent) in order to load the data into your table.

Ready to give it a shot?
Get the latest version (for free) here: http://www.doccolabs.com/products_cliptable.html

Cheers

Monday, September 24, 2012

Calling all SQL Azure users!

Today, we've released two new versions for both ClipTable & Log Table Viewer which, for the first time, enable full support for Windows Azure environment, SQL Azure in specific.

What this means is -

In Log Table Viewer - you can now apply the logger solution directly into your SQL Azure database, and use the client directly with the database to explore your log messages

In ClipTable - every table you create on-the-fly using ClipTable's superb import engine, can be created directly on your SQL Azure

Both new versions are available here:

http://www.doccolabs.com/products.html

Here's the full changelog for both versions:

Log Table Viewer:

- SQL Azure support. Full compatibility with Azure enables you to apply the logger solution on your Azure servers/databases

- Fixed GMT+0 reporting

v2.0.1.5 Released

ClipTable

- Added an option to generate an INSERT statement (content button next to "Execute")

- Boolean (BIT) datatype support/detection

- Tighter SQL Azure support, including:

- Automatic recognition

- Automatic Primary key check when Azure is detected

- Fixed BOOLEAN type on PostgreSQL

v1.0.3.0 Released

Wednesday, September 12, 2012

Triple Release day!

We have 3 updates today:

Database File Explorer v1.0.2.2 <link>

Log Table Viewer v2.0.1.4 <link>

ClipTable v1.0.2.9 <link>

And behind the scenes, some updates to our Shared Repository, which now supports integration and direct connectivity with Remote Desktop (RDP) and SQL Server Management Studio (SSMS)

Both available by right-clicking any server from within the repository:

Get your updates and enjoy!

Tuesday, August 14, 2012

Recent ClipTable usage - exciting

I usually don't share statistics, but this is just amazing:

With no budget, a bit of "Guerrilla marketing", ClipTable alone, has reached over 1,000 unique users from around the world in a bit over two months!

I am very excited to see this, and know this is only the beginning!

Let's continue spreading the word (I said Guerrilla, right?)
My objective is that every DBA (SQL Server, Oracle, MySQL, PostgreSQL) who deals with importing data into their databases (and that means - 99% of them) - Will work with ClipTable!

The other products also have amazing stats, which I'll share in the future. But today the honor goes to ClipTable.

If you're new here - get more information (& download) here: http://www.doccolabs.com/products_cliptable.html

Here's a static map from the past two months: (one marker per country, state/region-level not shown)

ClipTable usage over the globe

Thursday, August 2, 2012

New versions for ClipTable & DbFileExplorer

We've released new versions for both ClipTable & Database File Explorer this week, here's some of the change logs -

ClipTable:

- Applying limit buffer when importing directly from text files
- Fixed Oracle offline error message
- Added the following fields to summary: Database name & Estimated table size
- Added Cancel option for both Clipboard Import & Table Export
- Updated SQL Engine
- v1.0.2.6 Released

Database File Explorer:
- Added Table Properties (new window with extended table details, check it out by right-clicking any table)
- Better exception handling/reporting (during connection, data fill etc...)
- Minor UI fixes
- Few compatibility issues with SQL Server 2005 were addressed. However, it's time to upgrade people!
v1.0.2.0 released

Download or upgrade today, it's totally free!
http://www.doccolabs.com/products.html

As always, keep on sharing your experience with us; we always love to hear and respond.

Have a great week/weekend :)

Monday, May 14, 2012

ClipTable v1.0.1.8 released

I'm happy to announce a new release of ClipTable (v1.0.1.8)

This release has some new exciting features, including:

- Direct file import: while we focus on using the clipboard to turn any data into a table, we've added an option to use the same smart engine to import a file (as long as it's a readable text file) into a table. In order to use this, simply click the "more options" icon next to the import button (see image)

- Server info: when using the shared-repository, you can now get a quick essential information on each server by right-click and choosing the "Server Info" option (again, image...)

Here's the entire change-log for the v1.0.1.8:

- Added an option to import directly from a file (as long as it's a csv/text readable)
- New toggle option - treat empty strings as NULL or leave them as-is (in the database)
- New toggle option - remove invalid chars from column headers
- Repository instant groups works about x10 faster
- Repository version has been updated
- Fixed a bug in repository where not all instant groups were displayed in some cases
- Quick server info added to repository
- SQL Engine updated (faster async processing)
- Some UI changes

Go grab it now!

Tuesday, May 8, 2012

New versions + updated shared repository

Hey there,
There are new versions available for both ClipTable and Log Table Viewer

One of the many changes (for both) is a new version of our Shared Repository, which now introduces an 'instant grouping'.
What is it, you ask?
Well, it's a quick option to group your server list by either online status and SQL version

"No no... I mean, what's this shared repository??"

Oh, in that case - Shared repository is a component shared by all of our applications, which allows you to manage one central list for all of your (SQL) servers in your network.
The shared repository can be accessed from everywhere. So, if you install our products on various machines, you can still manage that one single list.

Here's a recent screenshot of the shared repository taken from the latest version (with the instant grouping)

Sunday, February 19, 2012

ClipTable now supports MySQL & PostgreSQL

This is a follow-up to our previous post was - Get to know ClipTable.
We've got a lot of feedback from SQL Server users who started using ClipTable on a daily basis.
In addition, the word has spread beyond the SQL Server community and we actually got some requests to have ClipTable support other database engines.

SO WE DID!
And even created a new/modified logo, here goes:

As from the latest version, ClipTable also supports MySQL and PostgreSQL!

Few things to keep in mind though,

This is only the first beta to support these engines, which means errors may occur. Be nice and report to us any misbehavior you find.
ClipTable is a Windows app, so apologies to all mysql/postgres who resent windows :)
Special connectors & drivers for each engine are not included within the setup. When loading the app you'll get links for each driver (if you already have them installed, nothing special to do)

Again, since this is quite preliminary, please let us know how your experience was like.

Get ClipTable here: http://www.doccolabs.com/products.html