Skip to content

Simple console app to upload folders to s3 and delete

Notifications You must be signed in to change notification settings

dixcart/s3archive

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

#S3Archive

A simple application that takes a list of folders and uploads them to S3, optionally ignoring open files, deleting and recursive searching.

Runs as a console application with a single XML file for config. Designed for cloud servers with small local storage but a regulatory requirement to keep logs. Run as a scheduled task to collect into an S3 bucket and interrogate your logs centrally.

NB: This application uploads data to S3, make sure you are aware of the cost implications and manage your own data retention policies.

##Download binary

Download S3Archive

Extract to a folder somewhere and follow instructions.

##Instructions

Run the file S3Archive.exe once, this will create a default config file and exit. Modify the xml file to include one folder element for each path you wish to send to S3.

###Fields/Attributes

  • includeOpen - Will also upload open files, defaults to false as webservers usually have an open file handle on the current log.
  • deleteOnUpload - Deletes file after it has been uploaded, there is currently no verification so use with caution.
  • recursive - Process all subdirectories or just the current.
  • path - The local path to the directory to scan.
  • bucket - The S3 bucket to store in. Must already be created, currently this is not created for you.
  • basePath - a prepended path to the S3 key for the file to allow you to use a single bucket for multiple sources.
  • pattern - File search pattern to use across all included directories

##License

Creative Commons Licence
S3Archive by Dixcart Technical Solutions Limited is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.

THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

About

Simple console app to upload folders to s3 and delete

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages