Bulk Export Documents along with metadata using large search list of records in DataPort


Hi, I am new to CM and trying to export a large/bulk list from Content Management Verson 10.1 contents (files, documents) along with the metadata. 

I have tried the DataPort utility for a record type and getting permissions error and checking with my Admin.

Do I need Admin access to export metadata and contents using the Dataport ?

Also, I have large list of records which I need to search and export and option to import my search list and export matching records.

Thanks,
AJ

  • 0

    The dataport is on the Administrator Tab and it is good at bulk creation or bulk import/export of records between datasets. If you are just wanting lists then I recommend you try a right click "send to" "Copy to Clipboard" you can manage what metadata you want by Formatting columns and then paste into Excel. Do you data analysis in Excel and then copy your Record Number column into The Records Work Tray

  • 0 in reply to 

    Thanks  Lirazel01 for your suggestions. I have large records and document list which I need to match in CM and do a bulk export along with metadata. 

    Exporting each record metadata by right click and copying will be difficult with large list of records and documents. Any other suggestions. Thanks. 

  • 0 in reply to 

    You can tag all and do the right click send to Clipboard you don't have to do one record at a time

  • 0 in reply to 

    Thanks Lirazel for your reply.  

    I am able to export the metadata, but also need to export documents (approximately 50K) . 

    I have a search criterion to search the record titles, uri, customer id.  I am unable to create the saved search with these three. Any suggestions on how to create a saved search which accepts my 50K list. 

    My goal is to export the matching records for this search using data port. 

  • Verified Answer

    +1   in reply to 

    Hi Arjun,

    DataPort is able to export records (including electronic attachments) based on your Saved Search.

    Once you have created a search that encompasses your records, save it as a Saved Search

    Once your search is setup then open Dataport:

    Data Direction -> Export

    Under Settings pick a directory that the 50k documents can be extracted into
    I tend to prefer DatabaseID and RecordURI for the name so the total path characters is smaller in length

    Under Export Properties the 'Source' will be a Saved Search, then select your Saved Search for the 50K list

    And then under Property List select any Additional Properties that you want to export.

    You should have both an Export File which contains the metadata as well as the documents now existing in the directory picked above titled based on the selected drop down.

    -Scotty

  • 0 in reply to   

    Thanks Scott for the detailed inductions. I am able to perform the export. I have trouble creating the saved search as my input is a large csv with random Doc record numbers. 

    I have 50+ record numbers to search and saved the list. I have tried to list the record numbers in search 

    Is there a way to pick up a list from csv file or SharePoint file for input to the saved search? 

  • Verified Answer

    +1   in reply to 

    Ahhh got you.

    There is no real easy way to do that.

    Possible Workaround:
    - For the records in question, apply them to a user label, then you can perform the search 'label:123' to find the items. This has the added benefit by easily being able to add / remove records from the label to then include them / not include them in the search. (You can copy and paste the record numbers from your CSV in bulk into your work tray to add them to your work tray and then add the user label or search by 'Work Tray' - have done this for 25k + items in the past just takes a while to paste in Slight smile)

    If you want to stick with Numbers, I tend to keep my searches at about 1000 numbers at a time (although I do URIs so not sure if the upper cap is different)

    I myself open up something like Notepad++, take 1000 numbers / lines, replace '\r\n' with a ',' to condense them into a single string with a comma separating each entry, and then paste into the search.

    Would be also possible for something like powershell to load the CSV, connect to CM via the SDK and Bulk create 'x' number of Saved Searches based on a 'split' amount ('x' record numbers).

    -Scotty

  • 0 in reply to   

    Thanks, Scotty for workaround. I think I will go with the copy paste option. Also pasting into tray is a good suggestion. 

    Apart from Dataport is there a way to do bulk export documents from CM like SDK or backend database etc. 

    To perform this export, do the user need admin access to DataPort? 

  • 0   in reply to 

    Hi Arjun,

    Yep - the .NET SDK would allow you to connect, search, and export documents.

    Have attached the online SDK .NET Help page
    https://content-manager-sdk.github.io/Community/233/index.html

    There is a 'Programming in Content Manager' category on the page which should hopefully help get you started. Works with C# VB.NET Powershell. There are a couple of other 'flavours' of the SDK (COM / ServiceAPI) which can connect via different means and would also work.

    For DataPort access, you don't need admin, but there is an 'Import and Export' user permission that would need to be granted.

    'Import and Export - permission to use the Content Manager DataPort import and export tool in Administration - Import/Export'

    Keep in mind that when exporting data, only data that you can see with the account that you connect with would be able to be exported. E.g. if your account can't see DOC24/123 then you can't export it with DataPort even with the generic 'Import and Export' permission granted.

    -Scotty