gb list returns empty output

[gosuri]

gb list returns an empty output, not sure what we'll need to further debug. Will update the issue as I investigate further.

Example:

$ gb list
$ echo $?
0
$ gb info
GB_PROJECT_DIR="/Users/gosuri/code/ovrclk/walker"
GB_SRC_PATH="/Users/gosuri/code/ovrclk/walker/src:/Users/gosuri/code/ovrclk/walker/vendor/src"
GB_PKG_DIR="/Users/gosuri/code/ovrclk/walker/pkg/darwin-amd64"
GB_BIN_SUFFIX="-darwin-amd64"
GB_GOROOT="/usr/local/Cellar/go/1.5.2/libexec"
$ go env
GOARCH="amd64"
GOBIN=""
GOEXE=""
GOHOSTARCH="amd64"
GOHOSTOS="darwin"
GOOS="darwin"
GOPATH="/Users/gosuri/code/go"
GORACE=""
GOROOT="/usr/local/Cellar/go/1.5.2/libexec"
GOTOOLDIR="/usr/local/Cellar/go/1.5.2/libexec/pkg/tool/darwin_amd64"
GO15VENDOREXPERIMENT=""
CC="clang"
GOGCCFLAGS="-fPIC -m64 -pthread -fno-caret-diagnostics -Qunused-arguments -fmessage-length=0 -fno-common"
CXX="clang++"
CGO_ENABLED="1"

[davecheney]

@gosuri i'm guessing that there is some code in this project. Could you include the output of tree $GB_PROJECT_DIR ?

[gosuri]

Here you go - https://gist.githubusercontent.com/gosuri/b43d2448444bfcefd1c9/raw/d297db09effec8e97963932c854ec592b25ed845/gb-tree.txt

[davecheney]

@gosuri thanks for the paste. I've pushed #482 with some basic tests for gb list, these confirm what I see with manual testing, which is a polite way of saying "i cannot reproduce what you see".

Can you do two things for me

1. Confirm that there are no symlinks in your project structure
2. Paste the output of go env DEBUG=. gb list

[gosuri]

Hmm.. That seems to have fixed it. Output:

$ env DEBUG=. gb list 2>&1 | pbcopy

2015/12/13 23:32:32 cmd.go:88: project root "/Users/gosuri/code/ovrclk/walker"
2015/12/13 23:32:32 context.go:325: matchPackages: /Users/gosuri/code/ovrclk/walker/src ...
2015/12/13 23:32:32 main.go:139: args: [go.ovrclk.com/walker/agency go.ovrclk.com/walker/agency/blob go.ovrclk.com/walker/agency/builder go.ovrclk.com/walker/api go.ovrclk.com/walker/api/v1 go.ovrclk.com/walker/clusters go.ovrclk.com/walker/clusters/topology go.ovrclk.com/walker/cmd/depricated/cmd go.ovrclk.com/walker/cmd/walker go.ovrclk.com/walker/cmd/walker-dev go.ovrclk.com/walker/cmp go.ovrclk.com/walker/cmp/app go.ovrclk.com/walker/cmp/container go.ovrclk.com/walker/cmp/kube go.ovrclk.com/walker/cmp/proxy go.ovrclk.com/walker/cmp/replicator go.ovrclk.com/walker/cmp/secrets go.ovrclk.com/walker/cmp/task go.ovrclk.com/walker/cmp/util go.ovrclk.com/walker/cmp/volumes go.ovrclk.com/walker/db go.ovrclk.com/walker/errors go.ovrclk.com/walker/farms go.ovrclk.com/walker/fixtures/go-simple go.ovrclk.com/walker/internal/gen/bashc go.ovrclk.com/walker/internal/gen/datacenters go.ovrclk.com/walker/net/apigateway go.ovrclk.com/walker/net/auth go.ovrclk.com/walker/net/blobstore go.ovrclk.com/walker/net/http go.ovrclk.com/walker/net/http/logger go.ovrclk.com/walker/net/rpc go.ovrclk.com/walker/pkg/auth go.ovrclk.com/walker/pkg/authority go.ovrclk.com/walker/pkg/bootstrap go.ovrclk.com/walker/pkg/datacenters go.ovrclk.com/walker/pkg/git go.ovrclk.com/walker/pkg/manifest go.ovrclk.com/walker/pkg/services go.ovrclk.com/walker/pkg/sys go.ovrclk.com/walker/pkg/users go.ovrclk.com/walker/pkg/vault go.ovrclk.com/walker/pkg/walkercmd go.ovrclk.com/walker/runtime go.ovrclk.com/walker/sysapi go.ovrclk.com/walker/tf go.ovrclk.com/walker/util go.ovrclk.com/walker/util/assert go.ovrclk.com/walker/util/awsutil go.ovrclk.com/walker/util/cloudinit go.ovrclk.com/walker/util/fileutil go.ovrclk.com/walker/util/math go.ovrclk.com/walker/util/netutil go.ovrclk.com/walker/util/strutil go.ovrclk.com/walker/v1/net/http go.ovrclk.com/walker/v1/net/http/logger go.ovrclk.com/walker/v1/net/http/proxy go.ovrclk.com/walker/v1/net/http/router go.ovrclk.com/walker/v1/net/rpc go.ovrclk.com/walker/v1/net/rpc/client go.ovrclk.com/walker/v1/net/rpc/testutil go.ovrclk.com/walker/v1/runtime go.ovrclk.com/walker/v1/services go.ovrclk.com/walker/v1/services/apps go.ovrclk.com/walker/v1/services/auth go.ovrclk.com/walker/v1/services/certs go.ovrclk.com/walker/v1/services/clusters go.ovrclk.com/walker/v1/services/data go.ovrclk.com/walker/v1/services/datacenters go.ovrclk.com/walker/v1/services/regions go.ovrclk.com/walker/v1/services/releases go.ovrclk.com/walker/v1/services/users go.ovrclk.com/walker/v1/store go.ovrclk.com/walker/v1/store/objects go.ovrclk.com/walker/version]
go.ovrclk.com/walker/agency
go.ovrclk.com/walker/agency/blob
go.ovrclk.com/walker/agency/builder
go.ovrclk.com/walker/api
go.ovrclk.com/walker/api/v1
go.ovrclk.com/walker/clusters
go.ovrclk.com/walker/clusters/topology
go.ovrclk.com/walker/cmd/depricated/cmd
go.ovrclk.com/walker/cmd/walker
go.ovrclk.com/walker/cmd/walker-dev
go.ovrclk.com/walker/cmp
go.ovrclk.com/walker/cmp/app
go.ovrclk.com/walker/cmp/container
go.ovrclk.com/walker/cmp/kube
go.ovrclk.com/walker/cmp/proxy
go.ovrclk.com/walker/cmp/replicator
go.ovrclk.com/walker/cmp/secrets
go.ovrclk.com/walker/cmp/task
go.ovrclk.com/walker/cmp/util
go.ovrclk.com/walker/cmp/volumes
go.ovrclk.com/walker/db
go.ovrclk.com/walker/errors
go.ovrclk.com/walker/farms
go.ovrclk.com/walker/fixtures/go-simple
go.ovrclk.com/walker/internal/gen/bashc
go.ovrclk.com/walker/internal/gen/datacenters
go.ovrclk.com/walker/net/apigateway
go.ovrclk.com/walker/net/auth
go.ovrclk.com/walker/net/blobstore
go.ovrclk.com/walker/net/http
go.ovrclk.com/walker/net/http/logger
go.ovrclk.com/walker/net/rpc
go.ovrclk.com/walker/pkg/auth
go.ovrclk.com/walker/pkg/authority
go.ovrclk.com/walker/pkg/bootstrap
go.ovrclk.com/walker/pkg/datacenters
go.ovrclk.com/walker/pkg/git
go.ovrclk.com/walker/pkg/manifest
go.ovrclk.com/walker/pkg/services
go.ovrclk.com/walker/pkg/sys
go.ovrclk.com/walker/pkg/users
go.ovrclk.com/walker/pkg/vault
go.ovrclk.com/walker/pkg/walkercmd
go.ovrclk.com/walker/runtime
go.ovrclk.com/walker/sysapi
go.ovrclk.com/walker/tf
go.ovrclk.com/walker/util
go.ovrclk.com/walker/util/assert
go.ovrclk.com/walker/util/awsutil
go.ovrclk.com/walker/util/cloudinit
go.ovrclk.com/walker/util/fileutil
go.ovrclk.com/walker/util/math
go.ovrclk.com/walker/util/netutil
go.ovrclk.com/walker/util/strutil
go.ovrclk.com/walker/v1/net/http
go.ovrclk.com/walker/v1/net/http/logger
go.ovrclk.com/walker/v1/net/http/proxy
go.ovrclk.com/walker/v1/net/http/router
go.ovrclk.com/walker/v1/net/rpc
go.ovrclk.com/walker/v1/net/rpc/client
go.ovrclk.com/walker/v1/net/rpc/testutil
go.ovrclk.com/walker/v1/runtime
go.ovrclk.com/walker/v1/services
go.ovrclk.com/walker/v1/services/apps
go.ovrclk.com/walker/v1/services/auth
go.ovrclk.com/walker/v1/services/certs
go.ovrclk.com/walker/v1/services/clusters
go.ovrclk.com/walker/v1/services/data
go.ovrclk.com/walker/v1/services/datacenters
go.ovrclk.com/walker/v1/services/regions
go.ovrclk.com/walker/v1/services/releases
go.ovrclk.com/walker/v1/services/users
go.ovrclk.com/walker/v1/store
go.ovrclk.com/walker/v1/store/objects
go.ovrclk.com/walker/version
2015/12/13 23:32:33 context.go:201: removing work directory: /var/folders/_k/653dngqj6vb24bfng2gfzhlh0000gn/T/gb937736538

[gosuri]

I could reproduce the error, it happens when the parent dir is a symlink:

$ ln -s /Users/gosuri/code /Users/gosuri/code1 
$ cd /Users/gosuri/code1/ovrclk/walker 
$ env DEBUG=. gb list
2015/12/13 23:48:06 cmd.go:88: project root "/Users/gosuri/code/ovrclk/walker"
2015/12/13 23:48:06 context.go:325: matchPackages: /Users/gosuri/code/ovrclk/walker/src ../../../../code1/ovrclk/walker/...
2015/12/13 23:48:06 main.go:139: args: []
2015/12/13 23:48:06 context.go:201: removing work directory: /var/folders/_k/653dngqj6vb24bfng2gfzhlh0000gn/T/gb880982421

[davecheney]

That is expected. Because gb uses the go/build package it retains the latter's dislike of symlinked directory structures. It's best to avoid them in your gb projects.

With that said, you've symlinked at a level above the project directory, so this should be ok.

[gosuri]

That makes sense. Also, it seems to be ok with symlinks inside the tree:

        ├── util
        │   ├── assert
        │   │   └── asserts.go
        │   ├── awsutil
        │   │   └── creds.go
        │   ├── cloudinit
        │   │   ├── config.go
        │   │   └── files.go
        │   ├── fileutil
        │   │   ├── copy.go
        │   │   ├── copy_test.go
        │   │   ├── dir.go
        │   │   ├── dir_test.go
        │   │   ├── http.go
        │   │   ├── tar.go
        │   │   ├── tar_test.go
        │   │   └── test
        │   │       ├── testdir
        │   │       │   ├── file1
        │   │       │   ├── file2
        │   │       │   └── link1 -> ../testdir3/file2
        │   │       ├── testdir3
        │   │       │   ├── file1
        │   │       │   └── file2
        │   │       ├── testfile
        │   │       ├── testfile2
        │   │       └── testfile3

[davecheney]

go/build ignores any file or directory starting with _, ., or the word testdata. It doesn't consider them source, even if they are symlinks.

On 14 Dec 2015, at 19:07, Greg Osuri notifications@github.com wrote:

That makes sense. Also, it seems to be ok with symlinks inside the tree:

    ├── util
    │   ├── assert
    │   │   └── asserts.go
    │   ├── awsutil
    │   │   └── creds.go
    │   ├── cloudinit
    │   │   ├── config.go
    │   │   └── files.go
    │   ├── fileutil
    │   │   ├── copy.go
    │   │   ├── copy_test.go
    │   │   ├── dir.go
    │   │   ├── dir_test.go
    │   │   ├── http.go
    │   │   ├── tar.go
    │   │   ├── tar_test.go
    │   │   └── test
    │   │       ├── testdir
    │   │       │   ├── file1
    │   │       │   ├── file2
    │   │       │   └── link1 -> ../testdir3/file2
    │   │       ├── testdir3
    │   │       │   ├── file1
    │   │       │   └── file2
    │   │       ├── testfile
    │   │       ├── testfile2
    │   │       └── testfile3

—
Reply to this email directly or view it on GitHub.

[gosuri]

Good deal. Thanks so much!

[davecheney]

@gosuri thanks for the repro. I think I found the problem and if #483 passes, I'll merge it.