Skip to content

Commit

Permalink
build: 修改自有仓库维护的代码为公司的group
Browse files Browse the repository at this point in the history
1.考虑到Apache Hadoop从3.3.0以后才正式支持COS,因此对于3.3.0以前的历史版本维护一份包到com.qcloud.cos这个group下面
2.拆分成hadoop-cos-{hadoop.version}-{version}.jar和cos_api-bundle-{version}.jar两个依赖包
  • Loading branch information
yuyang733 committed Sep 1, 2020
1 parent ba43083 commit 93d7326
Show file tree
Hide file tree
Showing 6 changed files with 6 additions and 6 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,12 +16,12 @@ Hadoop-2.6.0及以上版本
## 安装方法

### 获取 hadoop-cos 插件
下载地址:[hadoop-cos 插件](https://github.com/tencentyun/hadoop-cos)
下载地址:[hadoop-cos 插件](https://github.com/tencentyun/hadoop-cos/releases)


### 安装hadoop-cos插件

1. 将dep目录下的hadoop-cos-X.X.X-shaded.jar 拷贝到 `$HADOOP_HOME/share/hadoop/tools/lib`下。
1. 将hadoop-cos-{hadoop.version}-x.x.x.jar和cos_api-bundle-5.x.x.jar 拷贝到 `$HADOOP_HOME/share/hadoop/tools/lib`下。

NOTE: 根据hadoop的具体版本选择对应的jar包,若dep目录中没有提供匹配版本的jar包,可自行通过修改pom文件中hadoop版本号,重新编译生成。

Expand Down
Binary file removed dep/hadoop-cos-2.6.5-shaded.jar
Binary file not shown.
Binary file removed dep/hadoop-cos-2.7.5-shaded.jar
Binary file not shown.
Binary file removed dep/hadoop-cos-2.8.5-shaded.jar
Binary file not shown.
6 changes: 3 additions & 3 deletions pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,9 @@
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>

<groupId>org.apache.hadoop</groupId>
<groupId>com.qcloud.cos</groupId>
<artifactId>hadoop-cos</artifactId>
<version>3.1.0</version>
<version>${hadoop.version}-5.8.4</version>
<packaging>jar</packaging>

<name>Apache Hadoop Tencent Qcloud COS Support</name>
Expand All @@ -20,7 +20,7 @@
<maven.compiler.source>1.8</maven.compiler.source>
<maven.compiler.target>1.8</maven.compiler.target>
<hadoop.version>3.1.0</hadoop.version>
<cos_api.version>5.6.18</cos_api.version>
<cos_api.version>5.6.19</cos_api.version>
<google.guava.version>24.1.1-jre</google.guava.version>
<commons_lang3.version>3.1</commons_lang3.version>
<junit.version>4.8</junit.version>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -407,7 +407,7 @@ public int compare(PartETag o1, PartETag o2) {
}

private FileMetadata QueryObjectMetadata(String key) throws IOException {
LOG.info("Query Object metadata....");
LOG.debug("Query Object metadata. cos key: {}.", key);
GetObjectMetadataRequest getObjectMetadataRequest =
new GetObjectMetadataRequest(bucketName, key);

Expand Down

0 comments on commit 93d7326

Please sign in to comment.