Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix db_stress for custom env #5122

Closed
wants to merge 7 commits into from

Conversation

riversand963
Copy link
Contributor

@riversand963 riversand963 commented Mar 28, 2019

Fix some hdfs-related code so that it can compile and run 'db_stress'

Test plan:

$source ./hdfs/setup.sh
$make -j32 db_stress
$./db_stress --hdfs="hdfs://localhost:18020/rocksdb" --db="hdfs://localhost:18020/rocksdb" --verify_checksum -ops_per_thread=100000

The stack trace printed at the beginning of the test results from HDFS client which catches the RemoteException and decides to print the stack trace.

Summary: unnecessary because HdfsLogger is not the owner of writable file. The
owner will close it on close or destruction.
@riversand963
Copy link
Contributor Author

Different hadoop distributions may have different ways to configure. It would be nice if somebody can have a script setting up environment variables, classpath, etc. for different hadoop distributions. I'm considering removing the config-related part of this PR, and commit only the code changes.

Copy link
Contributor

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@riversand963 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@riversand963 riversand963 changed the title Fix db_stress for hdfs env Fix db_stress for custom env Mar 28, 2019
Copy link
Contributor

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@riversand963 has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Contributor

@riversand963 merged this pull request in d77476e.

@riversand963 riversand963 deleted the hdfs_test branch March 29, 2019 03:36
vagogte pushed a commit to vagogte/rocksdb that referenced this pull request Jun 18, 2019
Summary:
Fix some hdfs-related code so that it can compile and run 'db_stress'
Pull Request resolved: facebook#5122

Differential Revision: D14675495

Pulled By: riversand963

fbshipit-source-id: cac280479efcf5451982558947eac1732e8bc45a
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants