Database - シドニーで働くプログラマーのBlog(今はIT会社の経営者)

Postgresのローカルの指定したテーブルデータをHerokuに移す方法

Jan 17, 2015

AD:

いろいろなやり方があるとは思うのですが、僕は下記のやり方で対応しました。
1.ローカルのデータをInsert文でDumpする

pg_dump -d your_database -t table_nme &gt; specific_table_dump.sql --inserts

1	pg_dump -d your_database -t table_nme > specific_table_dump.sql --inserts

–insertsの引数なしだとPostgresはCOPY文で出されるので、それだとHerokuに移す場合面倒なので、入れています。

2.HerokuのDBへPgAdminなどでつなげる

3.あとは上で作ったファイルをSQLを実行して終了

Twitter:
Warning: Undefined array key "Twitter" in /home/sazaeau/mizoshiri.com/public_html/blog.mizoshiri.com/wp-content/plugins/sns-count-cache/sns-count-cache.php on line 2897
0 | Facebook: 0 | Google Plus:
Warning: Undefined array key "Google+" in /home/sazaeau/mizoshiri.com/public_html/blog.mizoshiri.com/wp-content/plugins/sns-count-cache/sns-count-cache.php on line 2897
0 | Hatena: 0 | Pocket: 1 | Total: 1 | Feedly: 0

Selectの結果をInsertする by PostgreSQL

Nov 30, 2014

AD:

いろいろなやり方を試したのですが、fieldsをはじめに指定する下記の方法でやると型の問題でエラーがでなくなりましたので、メモ

INSERT INTO users (name,email,group_id)
SELECT name,email,43
FROM users WHERE group_id = 1;

INSERT INTO users (name,email,group_id)

SELECT name,email,43

FROM users WHERE group_id = 1;

HerokuのPostgresにローカルのpgAdminなので直接アクセス

Nov 30, 2014

AD:

HerokuのPostgresにローカルのpgAdminなどで直接アクセスしたい場合

$ heroku config --app appの名前 | grep HEROKU_POSTGRESQL
HEROKU_POSTGRESQL_色_URL: postgres://ユーザ名:パスワード@サーバ名:ポート/データベース

1 2	$ heroku config --app appの名前 \| grep HEROKU_POSTGRESQL HEROKU_POSTGRESQL_色_URL: postgres://ユーザ名:パスワード@サーバ名:ポート/データベース

Ruby 1.9.3 gem pg error in Ubuntu

Nov 21, 2014

AD:

環境

VagrantでUbuntu14.04
rbenvを使ってRuby 1.9.3-p551
gem pg
で下記のエラーがでました。

Gem::Installer::ExtensionBuildError: ERROR: Failed to build gem native extension.

        /home/vagrant/.rbenv/versions/1.9.3-p551/bin/ruby extconf.rb
checking for pg_config... yes
Using config values from /usr/bin/pg_config
You need to install postgresql-server-dev-X.Y for building a server-side extension or libpq-dev for building a client-side application.
You need to install postgresql-server-dev-X.Y for building a server-side extension or libpq-dev for building a client-side application.
checking for libpq-fe.h... *** extconf.rb failed ***
Could not create Makefile due to some reason, probably lack of
necessary libraries and/or headers.  Check the mkmf.log file for more
details.  You may need configuration options.

Provided configuration options:
	--with-opt-dir
	--without-opt-dir
	--with-opt-include
	--without-opt-include=${opt-dir}/include
	--with-opt-lib
	--without-opt-lib=${opt-dir}/lib
	--with-make-prog
	--without-make-prog
	--srcdir=.
	--curdir
	--ruby=/home/vagrant/.rbenv/versions/1.9.3-p551/bin/ruby
	--with-pg
	--without-pg
	--with-pg-dir
	--without-pg-dir
	--with-pg-include
	--without-pg-include=${pg-dir}/include
	--with-pg-lib
	--without-pg-lib=${pg-dir}/lib
	--with-pg-config
	--without-pg-config
	--with-pg_config
	--without-pg_config
/home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:381:in `try_do': The compiler failed to generate an executable file. (RuntimeError)
You have to install development tools first.
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:506:in `try_cpp'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:983:in `block in find_header'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:790:in `block in checking_for'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:284:in `block (2 levels) in postpone'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:254:in `open'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:284:in `block in postpone'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:254:in `open'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:280:in `postpone'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:789:in `checking_for'
	from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:982:in `find_header'
	from extconf.rb:40:in `<main>'


Gem files will remain installed in /var/www/html/hoge/vendor/bundle/ruby/1.9.1/gems/pg-0.13.2 for inspection.
Results logged to /var/www/html/hoge/vendor/bundle/ruby/1.9.1/gems/pg-0.13.2/ext/gem_make.out
An error occurred while installing pg (0.13.2), and Bundler cannot continue.
Make sure that `gem install pg -v '0.13.2'` succeeds before bundling.
</main>

Gem::Installer::ExtensionBuildError: ERROR: Failed to build gem native extension.

/home/vagrant/.rbenv/versions/1.9.3-p551/bin/ruby extconf.rb

checking for pg_config... yes

Using config values from /usr/bin/pg_config

You need to install postgresql-server-dev-X.Y for building a server-side extension or libpq-dev for building a client-side application.

checking for libpq-fe.h... *** extconf.rb failed ***

Could not create Makefile due to some reason, probably lack of

necessary libraries and/or headers. Check the mkmf.log file for more

details. You may need configuration options.

Provided configuration options:

--with-opt-dir

--without-opt-dir

--with-opt-include

--without-opt-include=${opt-dir}/include

--with-opt-lib

--without-opt-lib=${opt-dir}/lib

--with-make-prog

--without-make-prog

--srcdir=.

--curdir

--ruby=/home/vagrant/.rbenv/versions/1.9.3-p551/bin/ruby

--with-pg

--without-pg

--with-pg-dir

--without-pg-dir

--with-pg-include

--without-pg-include=${pg-dir}/include

--with-pg-lib

--without-pg-lib=${pg-dir}/lib

--with-pg-config

--without-pg-config

--with-pg_config

--without-pg_config

/home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:381:in `try_do': The compiler failed to generate an executable file. (RuntimeError)

You have to install development tools first.

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:506:in `try_cpp'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:983:in `block in find_header'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:790:in `block in checking_for'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:284:in `block (2 levels) in postpone'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:254:in `open'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:284:in `block in postpone'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:254:in `open'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:280:in `postpone'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:789:in `checking_for'

from /home/vagrant/.rbenv/versions/1.9.3-p551/lib/ruby/1.9.1/mkmf.rb:982:in `find_header'

from extconf.rb:40:in `<main>'

Gem files will remain installed in /var/www/html/hoge/vendor/bundle/ruby/1.9.1/gems/pg-0.13.2 for inspection.

Results logged to /var/www/html/hoge/vendor/bundle/ruby/1.9.1/gems/pg-0.13.2/ext/gem_make.out

An error occurred while installing pg (0.13.2), and Bundler cannot continue.

Make sure that `gem install pg -v '0.13.2'` succeeds before bundling.

</main>

解決

libpq-dev(UbuntuのPostgres系パッケージ)が入っていないが原因ですよねー

sudo apt-get install libpq-dev

1	sudo apt-get install libpq-dev

VagrantのUbuntuでenable_i18n()の言語設定のエラー

Feb 27, 2014

AD:

VagrantにPostgresをChef-Soloで入れてから、下記のエラーがでるようになりました。
recipeの書き方に問題があったようです。。。。

エラー内容

$ bundle install rails
Sorry, command-not-found has crashed! Please file a bug report at:
https://bugs.launchpad.net/command-not-found/+filebug
Please include the following information with the report:

command-not-found version: 0.3
Python version: 3.3.1 final 0
Distributor ID:	Ubuntu
Description:	Ubuntu 13.04
Release:	13.04
Codename:	raring
Exception information:

unsupported locale setting
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/CommandNotFound/util.py", line 24, in crash_guard
    callback()
  File "/usr/lib/command-not-found", line 69, in main
    enable_i18n()
  File "/usr/lib/command-not-found", line 40, in enable_i18n
    locale.setlocale(locale.LC_ALL, '')
  File "/usr/lib/python3.3/locale.py", line 541, in setlocale
    return _setlocale(category, locale)
locale.Error: unsupported locale setting

$ bundle install rails

Sorry, command-not-found has crashed! Please file a bug report at:

https://bugs.launchpad.net/command-not-found/+filebug

Please include the following information with the report:

command-not-found version: 0.3

Python version: 3.3.1 final 0

Distributor ID: Ubuntu

Description: Ubuntu 13.04

Release: 13.04

Codename: raring

Exception information:

unsupported locale setting

Traceback (most recent call last):

File "/usr/lib/python3/dist-packages/CommandNotFound/util.py", line 24, in crash_guard

callback()

File "/usr/lib/command-not-found", line 69, in main

enable_i18n()

File "/usr/lib/command-not-found", line 40, in enable_i18n

locale.setlocale(locale.LC_ALL, '')

File "/usr/lib/python3.3/locale.py", line 541, in setlocale

return _setlocale(category, locale)

locale.Error: unsupported locale setting

解決した方法

言語設定に問題があるようなので、下記の内容を設定して解決しました。

export LANGUAGE=en_US.UTF-8
export LANG=en_US.UTF-8
export LC_ALL=en_US.UTF-8
locale-gen en_US.UTF-8
sudo dpkg-reconfigure locales

export LANGUAGE=en_US.UTF-8

export LANG=en_US.UTF-8

export LC_ALL=en_US.UTF-8

locale-gen en_US.UTF-8

sudo dpkg-reconfigure locales

参考サイト

Herokuのrake db:migrateでエラー

Sep 14, 2013

AD:

Herokuにて、Deploy後に、rake migrateするとエラーで進めなかったのでメモしておきます。

状況

$ heroku run rake db:migrate --app appName --trace
rake aborted!
undefined method `[]' for nil:NilClass
/app/vendor/bundle/ruby/2.0.0/gems/activerecord-4.0.0/lib/active_record/tasks/database_tasks.rb:136:in `purge'
/app/vendor/bundle/ruby/2.0.0/gems/activerecord-4.0.0/lib/active_record/railties/databases.rake:361:in `block (3 levels) in <top>'
</top>

$ heroku run rake db:migrate --app appName --trace

rake aborted!

undefined method `[]' for nil:NilClass

/app/vendor/bundle/ruby/2.0.0/gems/activerecord-4.0.0/lib/active_record/tasks/database_tasks.rb:136:in `purge'

/app/vendor/bundle/ruby/2.0.0/gems/activerecord-4.0.0/lib/active_record/railties/databases.rake:361:in `block (3 levels) in <top>'

</top>

解決するまでにやったこと

Heroku Postgresを使用しているんですが、作成したものを一度削除し、再度作成しなおしました。
この時点で、エラー内容が変わりました。

$ heroku run rake db:migrate --app appName --trace
FATAL: role "roleName" is not permitted to log in (PG::Error)

1 2	$ heroku run rake db:migrate --app appName --trace FATAL: role "roleName" is not permitted to log in (PG::Error)

configで確認するとDATABASE_URLするとHEROKU_POSTGRESQL_カラー_URLが違っていました。

$ heroku config --app appName
DATABASE_URL:                postgres://(AWS&#12398;&#25509;&#32154;)
HEROKU_POSTGRESQL_&#12459;&#12521;&#12540;_URL: postgres://(AWS&#12398;&#25509;&#32154;)
$ heroku pg:promote HEROKU_POSTGRESQL_&#12459;&#12521;&#12540;_URL --app appName

$ heroku config --app appName

DATABASE_URL: postgres://(AWSの接続)

HEROKU_POSTGRESQL_カラー_URL: postgres://(AWSの接続)

$ heroku pg:promote HEROKU_POSTGRESQL_カラー_URL --app appName

この時点では、結局同じエラー”`[]’ for nil:NilClass”になりました。

最後にheroku restartしてPostgreSQLもrestartして接続ができるようになりましたー
でも、どうして、起きたのかはイマイチ不明。。。。

$ heroku restart --app appName --trace
$ heroku pg:reset --app appName --trace

1 2	$ heroku restart --app appName --trace $ heroku pg:reset --app appName --trace

ほかにもいろいろとPaaSのサービスを使用しているんですが、こういう時にBlackBox化するので、やっかいですねー
ちなみに、ログはpapertrailを使用しているんですが、今回の状況だとログをみても原因が追求できませんでした。

could not bind IPv4 socket: Cannot assign requested address エラー by PostgreSQL

Aug 6, 2013

AD:

VagrantのUbuntuにPostgreSQLをインストールして、立ち上げようとすると下記のようなエラーがでたので、メモしておきます。

エラー内容

$ apt-get update
$ apt-get install postgresql
$ psql --version
psql (PostgreSQL) 9.1.9
$ service postgresql start
* Restarting PostgreSQL 9.1 database server                                                                                                                                
* The PostgreSQL server failed to start. Please check the log output:
2013-08-05 22:19:14 UTC LOG:  could not bind IPv4 socket: Cannot assign requested address
2013-08-05 22:19:14 UTC HINT:  Is another postmaster already running on port 5432? If not, wait a few seconds and retry.
2013-08-05 22:19:14 UTC WARNING:  could not create listen socket for "localhost"
2013-08-05 22:19:14 UTC FATAL:  could not create any TCP/IP sockets

$ apt-get update

$ apt-get install postgresql

$ psql --version

psql (PostgreSQL) 9.1.9

$ service postgresql start

* Restarting PostgreSQL 9.1 database server

* The PostgreSQL server failed to start. Please check the log output:

2013-08-05 22:19:14 UTC LOG: could not bind IPv4 socket: Cannot assign requested address

2013-08-05 22:19:14 UTC HINT: Is another postmaster already running on port 5432? If not, wait a few seconds and retry.

2013-08-05 22:19:14 UTC WARNING: could not create listen socket for "localhost"

2013-08-05 22:19:14 UTC FATAL: could not create any TCP/IP sockets

解決方法

コネクション指定の問題なので、下記のように変更しました。

$ vi /etc/postgresql/9.1/main/postgresql.conf
#listen_addresses = 'localhost'
&#12288;&darr;
listen_addresses = '*'

$ vi /etc/postgresql/9.1/main/postgresql.conf

#listen_addresses = 'localhost'

　↓

listen_addresses = '*'

ZendFramework 1.12.* と Doctrine 2.3.*の連携

Feb 24, 2013

AD:

仕事でZendFramework1.*を使用することになったので、ORMにDoctrine2.3.*を使用してみました。
下記の記事は、ある程度ZendFrameworkを触ったことがある方が対象になると思います。

構築環境

composerを使ってやりたかったのですが、うまくいかなかったので、結局手動で、Fileをダウンロードして設定しました。

Ubuntu 12.04
PHP 5.3.10
memcache 2.2.7
ZendFramework 1.12.1
Doctrine 2.3.0

設定に入る前に

KDF Memoさんの記事を参考に導入しました。
おそらく、KDF Memoさんものより、Versionが上がっているので、File構成がだいぶ変わってきているので、地味に設定に時間がかかりました。

最終的に僕のFile構成はこうなりました。

設定

まず、必要なものをダウンロード
Doctrine ORMよりLatestをダウンロードして、./library/vendor/に入れる
zendframework1-doctrine2より、Bisnaをダウンロードして、./libraryに入れるbinフォルダをコピーして、./に移動

cacheの設定などは、KDF Memoさんの記事に詳しく書いてありますのでそちらを参照してください。

application.iniを書き換える

[production]

; --------------------------
; PHP Specific Configuration
; --------------------------
phpSettings.display_startup_errors = 0
phpSettings.display_errors = 0

includePaths.library = APPLICATION_PATH "/../library"


; ----------------------------------------
; Zend Framework Application Configuration
; ----------------------------------------
bootstrap.path = APPLICATION_PATH "/Bootstrap.php"
bootstrap.class = "Bootstrap"

pluginPaths.BisnaApplicationResource = "Bisna/Application/Resource"

autoloaderNamespaces[] = Bisna
autoloaderNamespaces[] = ApplicationEntity

appnamespace = "Application"


; ------------------------------
; Front Controller Configuration
; ------------------------------

resources.frontController.controllerDirectory = APPLICATION_PATH "/controllers"
resources.frontController.params.displayExceptions = 0


; ------------------------------------------------------------------------------
; Doctrine Class Loader Configuration
; ------------------------------------------------------------------------------

resources.doctrine.classLoader.loaderClass = "DoctrineCommonClassLoader"
resources.doctrine.classLoader.loaderFile  = APPLICATION_PATH "/../library/vendor/Doctrine/Doctrine/Common/ClassLoader.php"

resources.doctrine.classLoader.loaders.doctrine_common.namespace   = "DoctrineCommon"
resources.doctrine.classLoader.loaders.doctrine_common.includePath = APPLICATION_PATH "/../library/vendor/Doctrine"

resources.doctrine.classLoader.loaders.doctrine_dbal.namespace   = "DoctrineDBAL"
resources.doctrine.classLoader.loaders.doctrine_dbal.includePath = APPLICATION_PATH "/../library/vendor/Doctrine"

resources.doctrine.classLoader.loaders.doctrine_orm.namespace   = "DoctrineORM"
resources.doctrine.classLoader.loaders.doctrine_orm.includePath = APPLICATION_PATH "/../library/vendor/Doctrine"

resources.doctrine.classLoader.loaders.symfony_console.namespace   = "SymfonyComponentConsole"
resources.doctrine.classLoader.loaders.symfony_console.includePath = APPLICATION_PATH "/../library/vendor/Doctrine/Doctrine"

resources.doctrine.classLoader.loaders.symfony_yaml.namespace   = "SymfonyComponentYaml"
resources.doctrine.classLoader.loaders.symfony_yaml.includePath = APPLICATION_PATH "/../library/vendor/Doctrine/Doctrine"

; ------------------------------------------------------------------------------
; Doctrine Cache Configuration
; ------------------------------------------------------------------------------

; Points to default cache instance to be used. Optional is only one cache is defined
resources.doctrine.cache.defaultCacheInstance = default

; Cache Instance configuration for "default" cache
;resources.doctrine.cache.instances.default.id = default
resources.doctrine.cache.instances.default.adapterClass = "DoctrineCommonCacheMemcacheCache"
resources.doctrine.cache.instances.default.namespace    = "Application_"
resources.doctrine.cache.instances.default.options.servers.0.host = localhost
resources.doctrine.cache.instances.default.options.servers.0.port = 11211
;resources.doctrine.cache.instances.default.options.servers.0.persistent    = true
;resources.doctrine.cache.instances.default.options.servers.0.weight        = 1
;resources.doctrine.cache.instances.default.options.servers.0.timeout       = 1
;resources.doctrine.cache.instances.default.options.servers.0.retryInterval = 15
;resources.doctrine.cache.instances.default.options.servers.0.status        = true

; ------------------------------------------------------------------------------
; Doctrine DBAL Configuration
; ------------------------------------------------------------------------------

; Points to default connection to be used. Optional if only one connection is defined
resources.doctrine.dbal.defaultConnection = default

; DBAL Connection configuration for "default" connection
;resources.doctrine.dbal.connections.default.id = default
;resources.doctrine.dbal.connections.default.eventManagerClass  = "DoctrineCommonEventManager"
;resources.doctrine.dbal.connections.default.eventSubscribers[] = "DoctrineExtensionsSluggableSluggableSubscriber"
;resources.doctrine.dbal.connections.default.configurationClass = "DoctrineDBALConfiguration"
;resources.doctrine.dbal.connections.default.sqlLoggerClass     = "DoctrineDBALLoggingEchoSQLLogger"
;resources.doctrine.dbal.connections.default.types.my_type      = "ApplicationDBALTypeMyType"

; Database configuration
;resources.doctrine.dbal.connections.default.parameters.wrapperClass = ""
resources.doctrine.dbal.connections.default.parameters.driver   = "pdo_mysql"
resources.doctrine.dbal.connections.default.parameters.dbname   = "databasename"
resources.doctrine.dbal.connections.default.parameters.host = "localhost"
resources.doctrine.dbal.connections.default.parameters.port = 3306
resources.doctrine.dbal.connections.default.parameters.user = "root"
resources.doctrine.dbal.connections.default.parameters.password = "password"
;resources.doctrine.dbal.connections.default.parameters.driverOptions.ATTR_USE_BUFFERED_QUERIES = true


; ------------------------------------------------------------------------------
; Doctrine ORM Configuration
; ------------------------------------------------------------------------------

; Points to default EntityManager to be used. Optional if only one EntityManager is defined
resources.doctrine.orm.defaultEntityManager = default

; EntityManager configuration for "default" manager
;resources.doctrine.orm.entityManagers.default.id = default
;resources.doctrine.orm.entityManagers.default.entityManagerClass   = "DoctrineORMEntityManager"
;resources.doctrine.orm.entityManagers.default.configurationClass   = "DoctrineORMConfiguration"
;resources.doctrine.orm.entityManagers.default.defaultRepositoryClass   = "DoctrineORMEntityRepository"
;resources.doctrine.orm.entityManagers.default.entityNamespaces.app = "ApplicationEntity"
;resources.doctrine.orm.entityManagers.default.connection     = default
;resources.doctrine.orm.entityManagers.default.proxy.autoGenerateClasses = true
;resources.doctrine.orm.entityManagers.default.proxy.namespace           = "ApplicationEntityProxy"
;resources.doctrine.orm.entityManagers.default.proxy.dir                 = APPLICATION_PATH "/../library/Application/Entity/Proxy"
;resources.doctrine.orm.entityManagers.default.metadataCache = default
;resources.doctrine.orm.entityManagers.default.queryCache    = default
;resources.doctrine.orm.entityManagers.default.resultCache   = default
;resources.doctrine.orm.entityManagers.default.DQLFunctions.numeric.PI = "DoctrineExtensionsORMQueryFunctionsNumericPiFunction"
resources.doctrine.orm.entityManagers.default.metadataDrivers.annotationRegistry.annotationFiles[]     = APPLICATION_PATH "/../library/vendor/Doctrine/Doctrine/ORM/Mapping/Driver/DoctrineAnnotations.php"
;resources.doctrine.orm.entityManagers.default.metadataDrivers.annotationRegistry.annotationNamespaces.0.namespace   = "Gedmo"
;resources.doctrine.orm.entityManagers.default.metadataDrivers.annotationRegistry.annotationNamespaces.0.includePath = APPLICATION_PATH "/../library/vendor"
resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.adapterClass          = "DoctrineORMMappingDriverAnnotationDriver"
resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.mappingNamespace      = "ApplicationEntity"
resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.mappingDirs[]         = APPLICATION_PATH "/../library/Application/Entity"
resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.annotationReaderClass = "DoctrineCommonAnnotationsAnnotationReader"
resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.annotationReaderCache = default
;resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.annotationReaderNamespaces.App = "ApplicationDoctrineExtensionsORMMapping"

; DocumentManager configuration for "default" manager
resources.doctrine.odm.documentManagers.default.documentManagerClass 		= "DoctrineODMMongoDBDocumentManager"
resources.doctrine.odm.documentManagers.default.connectionString 			= "mongodb://localhost"
resources.doctrine.odm.documentManagers.default.type 						= "MongoDB"
resources.doctrine.odm.documentManagers.default.proxy.autoGenerateClasses 	= true
resources.doctrine.odm.documentManagers.default.proxy.namespace 			= "DocumentProxy"
resources.doctrine.odm.documentManagers.default.proxy.dir 					= APPLICATION_PATH "/data/doctrineDocumentProxies/Proxy"
resources.doctrine.odm.documentManagers.default.hydrator.dir 				= APPLICATION_PATH "/data/hydrator"
resources.doctrine.odm.documentManagers.default.hydrator.namespace 			= "Hydrators"
resources.doctrine.odm.documentManagers.default.metadataDrivers.annotationRegistry.annotationFiles[] = "Doctrine/ODM/MongoDB/Mapping/Annotations/DoctrineAnnotations.php"
resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.adapterClass 				 = "DoctrineODMMongoDBMappingDriverAnnotationDriver"
resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.mappingNamespace 			 = "ApplicationDocument"
resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.mappingDirs[] 			 = APPLICATION_PATH "/../library/Application/Entity"
resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.annotationReaderClass 	 = "DoctrineCommonAnnotationsAnnotationReader"
resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.annotationReaderCache 	 = "annotationCacheODM"

[staging : production]


[testing : production]
phpSettings.display_startup_errors = 1
phpSettings.display_errors = 1


[development : production]
phpSettings.display_startup_errors = 1
phpSettings.display_errors = 1
resources.frontController.params.displayExceptions = 1

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116

117

118

119

120

121

122

123

124

125

126

127

128

129

130

131

132

133

134

135

136

137

138

139

140

141

142

143

144

145

146

147

148

149

150

151

152

153

154

155

156

157

158

159

[production]

; --------------------------

; PHP Specific Configuration

; --------------------------

phpSettings.display_startup_errors = 0

phpSettings.display_errors = 0

includePaths.library = APPLICATION_PATH "/../library"

; ----------------------------------------

; Zend Framework Application Configuration

; ----------------------------------------

bootstrap.path = APPLICATION_PATH "/Bootstrap.php"

bootstrap.class = "Bootstrap"

pluginPaths.BisnaApplicationResource = "Bisna/Application/Resource"

autoloaderNamespaces[] = Bisna

autoloaderNamespaces[] = ApplicationEntity

appnamespace = "Application"

; ------------------------------

; Front Controller Configuration

; ------------------------------

resources.frontController.controllerDirectory = APPLICATION_PATH "/controllers"

resources.frontController.params.displayExceptions = 0

; ------------------------------------------------------------------------------

; Doctrine Class Loader Configuration

; ------------------------------------------------------------------------------

resources.doctrine.classLoader.loaderClass = "DoctrineCommonClassLoader"

resources.doctrine.classLoader.loaderFile = APPLICATION_PATH "/../library/vendor/Doctrine/Doctrine/Common/ClassLoader.php"

resources.doctrine.classLoader.loaders.doctrine_common.namespace = "DoctrineCommon"

resources.doctrine.classLoader.loaders.doctrine_common.includePath = APPLICATION_PATH "/../library/vendor/Doctrine"

resources.doctrine.classLoader.loaders.doctrine_dbal.namespace = "DoctrineDBAL"

resources.doctrine.classLoader.loaders.doctrine_dbal.includePath = APPLICATION_PATH "/../library/vendor/Doctrine"

resources.doctrine.classLoader.loaders.doctrine_orm.namespace = "DoctrineORM"

resources.doctrine.classLoader.loaders.doctrine_orm.includePath = APPLICATION_PATH "/../library/vendor/Doctrine"

resources.doctrine.classLoader.loaders.symfony_console.namespace = "SymfonyComponentConsole"

resources.doctrine.classLoader.loaders.symfony_console.includePath = APPLICATION_PATH "/../library/vendor/Doctrine/Doctrine"

resources.doctrine.classLoader.loaders.symfony_yaml.namespace = "SymfonyComponentYaml"

resources.doctrine.classLoader.loaders.symfony_yaml.includePath = APPLICATION_PATH "/../library/vendor/Doctrine/Doctrine"

; ------------------------------------------------------------------------------

; Doctrine Cache Configuration

; ------------------------------------------------------------------------------

; Points to default cache instance to be used. Optional is only one cache is defined

resources.doctrine.cache.defaultCacheInstance = default

; Cache Instance configuration for "default" cache

;resources.doctrine.cache.instances.default.id = default

resources.doctrine.cache.instances.default.adapterClass = "DoctrineCommonCacheMemcacheCache"

resources.doctrine.cache.instances.default.namespace = "Application_"

resources.doctrine.cache.instances.default.options.servers.0.host = localhost

resources.doctrine.cache.instances.default.options.servers.0.port = 11211

;resources.doctrine.cache.instances.default.options.servers.0.persistent = true

;resources.doctrine.cache.instances.default.options.servers.0.weight = 1

;resources.doctrine.cache.instances.default.options.servers.0.timeout = 1

;resources.doctrine.cache.instances.default.options.servers.0.retryInterval = 15

;resources.doctrine.cache.instances.default.options.servers.0.status = true

; ------------------------------------------------------------------------------

; Doctrine DBAL Configuration

; ------------------------------------------------------------------------------

; Points to default connection to be used. Optional if only one connection is defined

resources.doctrine.dbal.defaultConnection = default

; DBAL Connection configuration for "default" connection

;resources.doctrine.dbal.connections.default.id = default

;resources.doctrine.dbal.connections.default.eventManagerClass = "DoctrineCommonEventManager"

;resources.doctrine.dbal.connections.default.eventSubscribers[] = "DoctrineExtensionsSluggableSluggableSubscriber"

;resources.doctrine.dbal.connections.default.configurationClass = "DoctrineDBALConfiguration"

;resources.doctrine.dbal.connections.default.sqlLoggerClass = "DoctrineDBALLoggingEchoSQLLogger"

;resources.doctrine.dbal.connections.default.types.my_type = "ApplicationDBALTypeMyType"

; Database configuration

;resources.doctrine.dbal.connections.default.parameters.wrapperClass = ""

resources.doctrine.dbal.connections.default.parameters.driver = "pdo_mysql"

resources.doctrine.dbal.connections.default.parameters.dbname = "databasename"

resources.doctrine.dbal.connections.default.parameters.host = "localhost"

resources.doctrine.dbal.connections.default.parameters.port = 3306

resources.doctrine.dbal.connections.default.parameters.user = "root"

resources.doctrine.dbal.connections.default.parameters.password = "password"

;resources.doctrine.dbal.connections.default.parameters.driverOptions.ATTR_USE_BUFFERED_QUERIES = true

; ------------------------------------------------------------------------------

; Doctrine ORM Configuration

; ------------------------------------------------------------------------------

; Points to default EntityManager to be used. Optional if only one EntityManager is defined

resources.doctrine.orm.defaultEntityManager = default

; EntityManager configuration for "default" manager

;resources.doctrine.orm.entityManagers.default.id = default

;resources.doctrine.orm.entityManagers.default.entityManagerClass = "DoctrineORMEntityManager"

;resources.doctrine.orm.entityManagers.default.configurationClass = "DoctrineORMConfiguration"

;resources.doctrine.orm.entityManagers.default.defaultRepositoryClass = "DoctrineORMEntityRepository"

;resources.doctrine.orm.entityManagers.default.entityNamespaces.app = "ApplicationEntity"

;resources.doctrine.orm.entityManagers.default.connection = default

;resources.doctrine.orm.entityManagers.default.proxy.autoGenerateClasses = true

;resources.doctrine.orm.entityManagers.default.proxy.namespace = "ApplicationEntityProxy"

;resources.doctrine.orm.entityManagers.default.proxy.dir = APPLICATION_PATH "/../library/Application/Entity/Proxy"

;resources.doctrine.orm.entityManagers.default.metadataCache = default

;resources.doctrine.orm.entityManagers.default.queryCache = default

;resources.doctrine.orm.entityManagers.default.resultCache = default

;resources.doctrine.orm.entityManagers.default.DQLFunctions.numeric.PI = "DoctrineExtensionsORMQueryFunctionsNumericPiFunction"

resources.doctrine.orm.entityManagers.default.metadataDrivers.annotationRegistry.annotationFiles[] = APPLICATION_PATH "/../library/vendor/Doctrine/Doctrine/ORM/Mapping/Driver/DoctrineAnnotations.php"

;resources.doctrine.orm.entityManagers.default.metadataDrivers.annotationRegistry.annotationNamespaces.0.namespace = "Gedmo"

;resources.doctrine.orm.entityManagers.default.metadataDrivers.annotationRegistry.annotationNamespaces.0.includePath = APPLICATION_PATH "/../library/vendor"

resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.adapterClass = "DoctrineORMMappingDriverAnnotationDriver"

resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.mappingNamespace = "ApplicationEntity"

resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.mappingDirs[] = APPLICATION_PATH "/../library/Application/Entity"

resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.annotationReaderClass = "DoctrineCommonAnnotationsAnnotationReader"

resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.annotationReaderCache = default

;resources.doctrine.orm.entityManagers.default.metadataDrivers.drivers.0.annotationReaderNamespaces.App = "ApplicationDoctrineExtensionsORMMapping"

; DocumentManager configuration for "default" manager

resources.doctrine.odm.documentManagers.default.documentManagerClass = "DoctrineODMMongoDBDocumentManager"

resources.doctrine.odm.documentManagers.default.connectionString = "mongodb://localhost"

resources.doctrine.odm.documentManagers.default.type = "MongoDB"

resources.doctrine.odm.documentManagers.default.proxy.autoGenerateClasses = true

resources.doctrine.odm.documentManagers.default.proxy.namespace = "DocumentProxy"

resources.doctrine.odm.documentManagers.default.proxy.dir = APPLICATION_PATH "/data/doctrineDocumentProxies/Proxy"

resources.doctrine.odm.documentManagers.default.hydrator.dir = APPLICATION_PATH "/data/hydrator"

resources.doctrine.odm.documentManagers.default.hydrator.namespace = "Hydrators"

resources.doctrine.odm.documentManagers.default.metadataDrivers.annotationRegistry.annotationFiles[] = "Doctrine/ODM/MongoDB/Mapping/Annotations/DoctrineAnnotations.php"

resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.adapterClass = "DoctrineODMMongoDBMappingDriverAnnotationDriver"

resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.mappingNamespace = "ApplicationDocument"

resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.mappingDirs[] = APPLICATION_PATH "/../library/Application/Entity"

resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.annotationReaderClass = "DoctrineCommonAnnotationsAnnotationReader"

resources.doctrine.odm.documentManagers.default.metadataDrivers.drivers.0.annotationReaderCache = "annotationCacheODM"

[staging : production]

[testing : production]

phpSettings.display_startup_errors = 1

phpSettings.display_errors = 1

[development : production]

phpSettings.display_startup_errors = 1

phpSettings.display_errors = 1

resources.frontController.params.displayExceptions = 1

doctrineの動作確認

$ php bin/doctrine.php
Doctrine Command Line Interface version 2.3.0

Usage:
  [options] command [arguments]

Options:
  --help           -h Display this help message.
  --quiet          -q Do not output any message.
  --verbose        -v Increase verbosity of messages.
  --version        -V Display this application version.
  --ansi              Force ANSI output.
  --no-ansi           Disable ANSI output.
  --no-interaction -n Do not ask any interactive question.

$ php bin/doctrine.php

Doctrine Command Line Interface version 2.3.0

Usage:

[options] command [arguments]

Options:

--help -h Display this help message.

--quiet -q Do not output any message.

--verbose -v Increase verbosity of messages.

--version -V Display this application version.

--ansi Force ANSI output.

--no-ansi Disable ANSI output.

--no-interaction -n Do not ask any interactive question.

MongoDBコマンド＆検索クエリ

Feb 23, 2013

AD:

最近、仕事でMongoDBを使う機会があったので、MongoDBコマンド＆検索関係をまとめたいと思います。

検索クエリ

現時点で僕の理解しきれている範囲だとクエリの特徴は下記のような特徴があるようです。
– メソッドの引数にJSON形式のデータを渡す
– 変数が使える
– 制御構造が使える
– カーソルが使える

条件演算子

MongoDBは、JavascriptのエンジンであるSpiderMonkeyを拡張した、Javascriptシェル？です。
なので、JavaScriptの記述でデータのが取得が可能です。

$gt
greater than (i.e. &gt;)
$gte
greater than or equal (i.e. =&gt;)
$in 
field value equals any value in the specified array (e.g. <value1>, <value2>)
$lt
less than (i.e. 

&#12371;&#12385;&#12425;&#12398;<a href="http://gihyo.jp/dev/serial/01/mongodb/0003" targer="_blank">&#12506;&#12540;&#12472;</a>&#12289;<a href="http://docs.mongodb.org/manual/reference/operators/#AdvancedQueries-ConditionalOperators" targer="_blank">&#12506;&#12540;&#12472;</a>&#12434;&#21442;&#32771;&#12395;&#12375;&#12414;&#12375;&#12383;&#12290;

<h3>mongo &#12467;&#12510;&#12531;&#12489;</h3>
mongo&#12398;&#12467;&#12510;&#12531;&#12489;&#12398;&#12504;&#12523;&#12503;&#12398;&#19968;&#35239;&#12391;&#12377;&#12290;
<pre> mongo&#12288;
&gt; help
db.help()                    help on db methods
db.mycoll.help()             help on collection methods
sh.help()                    sharding helpers
rs.help()                    replica set helpers
help admin                   administrative help
help connect                 connecting to a db help
help keys                    key shortcuts
help misc                    misc things to know
help mr                      mapreduce
show dbs                     show database names
show collections             show collections in current database
show users                   show users in current database
show profile                 show most recent system.profile entries with time &gt;= 1ms
show logs                    show the accessible logger names
show log [name]              prints out the last segment of log in memory, 'global' is default
use <db_name>                set current database
db.foo.find()                list objects in collection foo
db.foo.find( { a : 1 } )     list objects in foo where a == 1
it                           result of the last line evaluated; use to further iterate
DBQuery.shellBatchSize = x   set default number of items to display on shell
exit                         quit the mongo shell
</db_name>

$gt

greater than (i.e. >)

$gte

greater than or equal (i.e. =>)

$in

field value equals any value in the specified array (e.g. <value1>, <value2>)

$lt

less than (i.e.

こちらの<a href="http://gihyo.jp/dev/serial/01/mongodb/0003" targer="_blank">ページ</a>、<a href="http://docs.mongodb.org/manual/reference/operators/#AdvancedQueries-ConditionalOperators" targer="_blank">ページ</a>を参考にしました。

<h3>mongo コマンド</h3>

mongoのコマンドのヘルプの一覧です。

<pre> mongo　

> help

db.help() help on db methods

db.mycoll.help() help on collection methods

sh.help() sharding helpers

rs.help() replica set helpers

help admin administrative help

help connect connecting to a db help

help keys key shortcuts

help misc misc things to know

help mr mapreduce

show dbs show database names

show collections show collections in current database

show users show users in current database

show profile show most recent system.profile entries with time >= 1ms

show logs show the accessible logger names

show log [name] prints out the last segment of log in memory, 'global' is default

use <db_name> set current database

db.foo.find() list objects in collection foo

db.foo.find( { a : 1 } ) list objects in foo where a == 1

it result of the last line evaluated; use to further iterate

DBQuery.shellBatchSize = x set default number of items to display on shell

exit quit the mongo shell

</db_name>

MongoDBの状況確認

Feb 23, 2013

AD:

ブラウザから確認

MongoDBをインストールした場合は、下記のURLにアクセスすると、MongoDBの状況が確認できるようです。
http://localhost:28017

ちなみに、上記の機能は–norestオプションで無効化できるらしいです。

コマンドから確認

ちなみに、コマンドでMongoの状況確認は下記の要します。

$ mongostat
connected to: 127.0.0.1
insert  query update delete getmore command flushes mapped  vsize    res faults  locked db idx miss %     qr|qw   ar|aw  netIn netOut  conn       time 
     0      0      0      0       0       1       0     0m   102m    23m      0 local:0.0%          0       0|0     0|0    62b     1k     1   05:26:35 
     0      0      0      0       0       1       0     0m   102m    23m      0 local:0.0%          0       0|0     0|0    62b     1k     1   05:26:36

$ mongostat

connected to: 127.0.0.1

insert query update delete getmore command flushes mapped vsize res faults locked db idx miss % qr|qw ar|aw netIn netOut conn time

0 0 0 0 0 1 0 0m 102m 23m 0 local:0.0% 0 0|0 0|0 62b 1k 1 05:26:35

0 0 0 0 0 1 0 0m 102m 23m 0 local:0.0% 0 0|0 0|0 62b 1k 1 05:26:36

その他

他にもいろいろな管理ツールがあるようです。

Postgresのローカルの指定したテーブルデータをHerokuに移す方法

Selectの結果をInsertする by PostgreSQL

HerokuのPostgresにローカルのpgAdminなので直接アクセス

Ruby 1.9.3 gem pg error in Ubuntu

環境

解決

VagrantのUbuntuでenable_i18n()の言語設定のエラー

エラー内容

解決した方法

Herokuのrake db:migrateでエラー

状況

解決するまでにやったこと

could not bind IPv4 socket: Cannot assign requested address エラー by PostgreSQL

エラー内容

解決方法

ZendFramework 1.12.* と Doctrine 2.3.*の連携

構築環境

設定に入る前に

設定

MongoDBコマンド＆検索クエリ

検索クエリ

条件演算子

MongoDBの状況確認

ブラウザから確認

コマンドから確認

その他

Search Keyword

Meta

FacebookPage

Popular Posts

My Tags

Status

Links

ARCHIVES